Mind-reading voice box could help doctors connect with patients who cannot talk

Technology translates brain signals responsible for vocal tract movements

A brain decoder that allows people literally to "speak their minds" could one day help doctors communicate with patients who cannot talk.

Scientists targeted nerve messages used in the physical process of speech to tap into the verbal thoughts of volunteers.

The technology generates synthesised spoken words from brain signals associated with movements of the jaw, larynx, lips and tongue.

At the start of the study, patterns of electrical activity were recorded from the brains of five volunteers as they spoke several hundred sentences aloud.

The passages were taken from well-known children's stories, including Sleeping Beauty, The Frog Prince, and Alice In Wonderland.

Armed with the recordings, the US team devised a system capable of translating brain signals responsible for individual movements of the vocal tract.

Finally, the decoded signals were fed to a neural network computer linked to a voice synthesiser.

In trials of 101 sentences, volunteer listeners were easily able to understand and transcribe the synthesised speech.

The research, led by Dr Edward Chang from the University of California at San Francisco, US, is reported in the latest issue of the journal Nature.

The scientists wrote: "Listeners were able to transcribe synthesised speech well. Of the 101 synthesised trials, at least one listener was able to provide a perfect transcription for 82 sentences with a 25-word pool and 60 sentences with a 50-word pool."

They added: "Our results may be an important next step in realising speech restoration for patients with paralysis."

Natural speech production involves more than 100 facial muscles, according to the scientists.

In a second part of the study, one participant was asked to speak sentences and then mime them without making a sound.

The decoder was able to read the brain signals associated with the mime and translate them into synthesised speech.

All the volunteers, four women and one man, were epilepsy patients who had undergone surgery to implant an electrode array on to their brain surfaces.

The electrocorticography technique is used to monitor electrical activity in the cerebral cortex.

Two experts writing in an accompanying News & Views article in Nature pointed out that speaking might seem effortless but was "one of the most complex actions that we perform".

Chethan Pandarinath and Yahia H Ali, from Emory University in Atlanta, US, added: "With continued progress, we can hope that individuals with speech impairments will regain the ability to freely speak their minds and reconnect with the world around them."

Press Association