Scientists create algorithm that 'reads' audio from near-invisible vibrations in silent videos
Engineers from MIT were able to recove audio from video footage of everyday objects including a potted plant, glass of water and teapot
Sound travels as vibrations through the air and whatever it hits vibrates too. If this is your ear then specialized hair cells translate these movements into something you can hear but for pretty much anything else these vibrations are simply lost.
Now, however, computer scientists have created an algorithim that translates these visual cues into an audio signal, 'reading' the near-invisible vibrations caused by people speaking or music playing from a range of everyday objects from a glass of water to a crisp packet.
Using video footage recorded by high speed cameras researchers from the Massachusetts Institute of Technology were able to listen to test subjects reading nursery rhymes from behind sound proof glass using only video of a crisp packet in the same room.
Previous techniques that recover sound from vibration have all relied on some sort of active interaction with the vibrating object (such as an infrared beam bouncing off a window using a ‘laser microphone’) but this new research needs only a visual signal.
Computer science graduate Abe Davis and his team were even able to extract audio from footage recorded by an ordinary digital camera and although the quality was good enough to make out distinct speech it was enough to identify information such as the number of people in a room and their gender.
These new techniques could have applications in law enforcement and forensics, but Davis has said that he’s more interested in a “new kind of imaging” that would allow scientists to analyse the material and structural properties of an object just by recording a video of it.
“We’re recovering sounds from objects,” he said in a press release. “That gives us a lot of information about the sound that’s going on around the object, but it also gives us a lot of information about the object itself, because different objects are going to respond to sound in different ways.”
Life & Style blogs
Dresden riots: Protesters in Germany attack refugee buses shouting 'foreigners out'
France train shooting: US soldiers speak of the moment they stopped gunman and 'beat him until he was unconscious'
Labour leadership: Jeremy Corbyn accused of 'deluding' young supporters with 'claptrap'
'Women only' train carriages: Jeremy Corbyn unveils radical move to tackle public harassment
Black holes are a passage to another universe, says Stephen Hawking
Iain Duncan Smith calls for urgent ESA overhaul as part of drive to cut down welfare costs
- 1 Video of Irish 'professional boxer' fighting Istanbul neighbourhood goes viral in Turkey
- 2 Novel Scarlett Johansson tried to ban, Grégoire Delacourt’s The First Thing You See, to be published in UK
- 3 Toby Sheldon: Justin Bieber lookalike found dead in motel room
- 4 Russia 'accidentally reveals' number of its soldiers killed in eastern Ukraine
- 5 Pregnant teenager Neysi Perez 'wakes up in coffin' a day after her funeral
iJobs Gadgets & Tech
£19000 - £23000 per annum: Recruitment Genius: This IT and Telecoms company ar...
£18000 - £24000 per annum: Recruitment Genius: A leading provider of ICT servi...
£20230 - £26000 per annum: Recruitment Genius: Are you looking for a career in...
£13500 - £15000 per annum: Recruitment Genius: This IT and Telecoms company is...