Jerry Tang

How does the human brain represent semantic information from different languages? Our new preprint suggests that bilingual language comprehension relies on shared semantic representations that are systematically modulated by each language! 1/n

Do brain representations of language depend on whether the inputs are pixels or sounds? Our @CommsBio paper studies this question from the perspective of language timescales. We find that representations are highly similar between modalities! rdcu.be/dACh5 1/8

I’ll be presenting this work at the #NeurIPS2023 5pm poster session on Wednesday — come by to chat about the relationship between language and vision in the brain!

This paper and dataset is now officially published in Scientific Data!! And not only that but we have nearly doubled the amount of data and stimulus available since the preprint version. Link to paper here: nature.com/articles/s4159… 1/n

Our new study is out today in Nature! We demonstrate a brain-computer interface that turns speech-related neural activity into text, enabling a person with paralysis to communicate at 62 words per minute - 3.4 times faster than prior work. 1/3 nature.com/articles/s4158…

Our paper on a high-performance neuroprosthesis for speech decoding and avatar control is out in Nature! Thankful to work with such a great interdisciplinary team on this. nature.com/articles/s4158…

🌟NEW PREPRINT🌟 🤖-based🧠models are all the rage! But, - How do we interpret 🧠if 🤖are SO un-interpretable? - How do we _test_ if🤖are good models of 🧠? (No, your prediction score is NOT the answer) Our new paper (co-lead @vvobot) shows you how! tinyurl.com/vojain2023 1/9

And here's a short explainer of how our decoder works and what it can do! youtube.com/watch?v=Fj6Z2r…

If you want to learn more about brain decoding, I wrote a quick introduction to how brain decoding technology works and how we think it could impact society @jerryptang/societal-implications-of-brain-decoding-94a2ba0f7448" target="_blank" rel="nofollow noopener">medium.com/@jerryptang/so…

Our language decoding paper (@AmandaLeBel3 @shaileeejain @alex_ander) is out! We found that it is possible to use functional MRI scans to predict the words that a user was hearing or imagining when the scans were collected nature.com/articles/s4159…

many thanks to the fantastic team @AmandaLeBel3 @shaileeejain @alex_ander that made this possible. we'll be at SNL and SFN over the next few months, so drop by if you'd like to learn more! (7/7)

very excited to share our paper on reconstructing language from non-invasive brain recordings! we introduce a decoder that takes in fMRI recordings and generates continuous language descriptions of perceived speech, imagined speech, and possibly much more biorxiv.org/content/10.110…

we hope to eventually offer a non-invasive alternative, but our decoder has a long way to go. other possible uses include memory and attention prostheses, but our results are just a step towards those goals as well (9/9)

finally, some have asked about the positive uses of brain decoding. our initial goal was to restore speech to people with locked-in syndrome. since then, intracranial decoders have gotten very good at speech restoration, and we didn't want to draw attention away from that (8/9)

this is generating a lot of discussion and we wanted to clear a few things up. first, we take privacy very seriously and reject the use of brain decoders for surveillance, interrogation, and other unethical applications