🚨IT'S HAPPENING🚨 a woman who cannot speak now speaks through her brain, in real time, with her own voice. no typing, delay, or sounds made. just neural intent to streaming speech this isn’t prediction. it’s embodiment 1/

a woman with complete paralysis and zero vocal function just regained the ability to speak at ~conversational speed. with AI, a brain implant learned to read her intention to speak and synthesized her words in her own voice. live. streaming. no delay 2/

not typing or text. actual speech. before this, the best systems let patients “type” at 8–14 words per minute. this one does 90+ WPM. in audio, with prosody. from brain activity alone. and it uses no audible training data. she doesn’t even need to try making sounds. 3/

the system: - a 253-channel ECoG array on her speech motor cortex - a deep neural decoder trained on 23,000 silent-speech attempts - RNN-T architecture decoding in 80ms chunks - dual output: synthesized speech + real-time transcript - voice personalized to her own, pre-injury audio 4/

the decoder streams speech every 80ms most systems wait for full sentences before outputting anything. this one doesn’t. it emits speech as the brain thinks. lag: ~1 second. the system literally streams her neural intention into speech in near real time. 5/

the speech is fast, fluent, and accurate on testing: 50-phrase set (caregiver needs): 91 WPM 12% word error rate (WER) 11% character error rate large 1,024-word set (natural sentences): 47 WPM 59% WER (harder) 45% character error rate it’s not perfect. but it works. 6/

it even decoded words it never saw the model successfully synthesized novel words not seen during training. when given 24 new silent words like “Zulu” or “Romeo,” it correctly identified them 46% of the time vs 3.8% by chance. from neural activity alone 7/

it also generalizes across tech the same neural architecture decoded speech from: - ECoG (surface brain electrodes) - MEA (intracortical microelectrodes) - EMG (surface facial electrodes, no surgery) silent speech, multiple inputs. one decoder framework. 8/

works continuously, not just in trials the system doesn’t need pre-programmed trials or cues it can detect when she starts and stops speaking from brain activity they tested it on 6-minute continuous silent speech blocks. it decoded accurately, with almost no false positives. 9/

and no, it’s not just parroting audio is it reacting to auditory feedback? no. they ran trials with and without speech feedback. result: no performance change, decoder works based on motor intent, not sound. it’s intention → speech. 10/

this is the new benchmark previous best decoding speed: 28 WPM this system: 90 WPM, at lower latency no need for vocalization and works with generalizable architecture and continuous, volitional use we’re entering the post-vocal age. 11/

clinically this gives speech back to people who’ve lost it technically it solves real-time, fluent neural speech decoding this will enable silent communication and shows that language can be purely neural 12/

today: ECoG in paralyzed patients. next: non-invasive silent speech interfaces (EMG → wearable). eventually: ambient, invisible BCI that lets you speak mind-to-mind. and one day we'll have internal language externalized without sound or typing. though to action models 13/

imagine 20 years from now: - no phones - no keyboards - no voice commands - you just think and your words are heard not as text or buttons. as your voice, in real time. pure thought to pure speech and action 14/

@IterIntellectus How much for a Faraday helmet?

@IterIntellectus @threadreaderapp unroll

@IterIntellectus is this something neural link could do?

@IterIntellectus Amazing , thank you gor posting Dottore !🩵🌸

@IterIntellectus Amazing! Also raises important questions over invasion of thoughts and privacy!

@IterIntellectus This fascinating. Wouldn't it imply that the signals can be reversed and the thoughts implanted into the communication centers of the brain? Or less diabolical, people will be able to communicate by thought alone at a speed faster than vocal chords.

@IterIntellectus Amazing what stuff comes out every year on April 1. Every month should be April just so we can get so much new, awesome stuff EVERY MONTH.

@IterIntellectus @threadreaderapp unroll

@IterIntellectus Deep inhale…MITM would be emotionally devastating

@IterIntellectus Wow, I can’t imagine the joy that the woman must feel ☺️

@IterIntellectus Implications are nuts. Once this goes ambient this is mind reading. Either our servitude will be complete, or we will be as gods…

@IterIntellectus @threadreaderapp unroll

@IterIntellectus Beautiful diagrams but where is the real video showing the person speaking using the technology? 🤔

@IterIntellectus Is the paper avalaible?

@IterIntellectus Fuck yeah thanks for sharing!

@IterIntellectus I think that transformers based stable diff model could give faster results

@IterIntellectus Patent Pending ?! The mad race in this mad mad mad mad world across all power point sectors plods then skips then gallops toward an actualization of command center intelligence at breakneck speed. That’s speed that gets a single neck broken “irregardless” the way. Funny words.

@IterIntellectus PUT IT ON A WHALE

@IterIntellectus 😀

@IterIntellectus people’s breath will be insane g

@IterIntellectus Did the AI actually read the thought in detail? Or did the generative AI simply fill in the blank and make it look more impressive than it actually see?