Andreas Tolias Lab @ Stanford University

1.2K posts

Andreas Tolias Lab @ Stanford University banner
Andreas Tolias Lab @ Stanford University

Andreas Tolias Lab @ Stanford University

@AToliasLab

to understand intelligence and develop technologies by combining neuroscience and AI

Palo Alto, CA Katılım Mayıs 2017
822 Takip Edilen5.1K Takipçiler
Sabitlenmiş Tweet
Andreas Tolias Lab @ Stanford University
A hundred years ago, Edgar Adrian recorded from a single nerve fibre and showed the stimulus out in the world is carried in the rate of its firing — he started calling the impulses a "code." We've been trying to read that code ever since. For parts of the brain like V1 we've had a good answer for more than fifty years, and it was written in math: a Gabor filter. Orientation, spatial frequency, phase — compact, and you could measure how well it fit. Deeper in the hierarchy, in areas like V4, we never had the equivalent. We mostly had qualitative descriptions — they fire to shape, color and texture — but couldn't write down a more precise one for a single neuron, let alone put a number on how well it captured what the neuron responds to. Our new paper from The Enigma Project, led by @vedanglad, uses vision-language models to write that correspondence in ordinary human words. The words don't just give a qualitative description of what each neuron is tuned for; crucially, they let you quantify how well that language captures the tuning. Take a neuron's description, regenerate fresh images from it with a diffusion model, show them to a digital twin, and measure: descriptions written to drive V4 neurons pushed 96.1% of them into the top 5% of their responses to natural images; descriptions written to suppress pushed 97.6% into the bottom 5%. So we now have an automated way to describe the map between neurons and the world — in human language, in the macaque brain. That opens a new avenue: describing biological neurons in the same currency we use to interpret artificial ones, and comparing mechanistic interpretability across brains and AI directly. This work is together with Nikos Karantzas, @kfrankelab @naturecomputes @SuryaGanguli @TamarRottShaham Many thanks to the rest of the team at the Enigma Project @Stanford and @jamesfickel for generous support
Vedang Lad@vedanglad

How well can you describe the feature selectivity of a vision neuron … with words? Interpretability has long borrowed from neuroscience — and maybe it can give back too! 🧵

English
0
17
55
7.1K
Andreas Tolias Lab @ Stanford University retweetledi
Andreas Tolias Lab @ Stanford University retweetledi
Vinod Khosla
Vinod Khosla@vkhosla·
I agree with @BillAckman . We will lose the global race for talent if we don't attract the best and brightest. Especially true of the AI race against China. Talent is a bigger factor in that race than the next three or four factors combined, including chips. We should push for a bipartisan effort. I think it can be done despite the administration's MAGA wing. Who in the administration can help this lady?
Bill Ackman@BillAckman

Our immigration policies need to be reformed to allow the best and brightest to be educated in the USA and stay here to create value for our country. As long as their values are aligned with the long-term interests of our country, their visas should be fast tracked. Can someone in immigration help this young woman?

English
238
70
1.1K
313.3K
Andreas Tolias Lab @ Stanford University retweetledi
codila
codila@0xCodila·
Kimi CEO Zhilin Yang: "Claude didn't win on reasoning - they bet everything on agents but the layer everyone skips - a great agent needs a great base model, that's all we do at Kimi 3 " in 90-min workshop he explains why the smartest agent still fails - if you can't configure it correctly his one big idea: most people are still solving the old one "the real goal? we want K2 to help build K3 - without agent skills, that's impossible" watch & bookmark - then learn the article on best agent system ↓
codila@0xCodila

x.com/i/article/2077…

English
143
1.1K
8.4K
1.2M
Andreas Tolias Lab @ Stanford University retweetledi
Katrin Franke
Katrin Franke@kfrankelab·
Very excited that our paper is now out at @arxiv🎉 As a neuroscientist🧠, I wand to understand how (single) neurons encode the visual world. But how to do this in an automated yet interpretable way when we record thousands of neurons to complex natural stimuli? Here, we use vision language models, specifically @GeminiApp, to convert neural selectivity in monkey visual cortex into language, i.e. a semantic hypothesis, which we verify with text-to-image generation! Check out the below post and this beautiful homepage by @vedanglad: enigma-brain.github.io/letting-the-ne… Great team effort with @AToliasLab @naturecomputes @SuryaGanguli @TamarRottShaham Nikos Karantzas & star first author @vedanglad 😍 This work was done at @StanfordMed and funded through The ENIGMA Project by @jamesfickel 🙏
Vedang Lad@vedanglad

How well can you describe the feature selectivity of a vision neuron … with words? Interpretability has long borrowed from neuroscience — and maybe it can give back too! 🧵

English
1
17
63
7.7K
Andreas Tolias Lab @ Stanford University retweetledi
The Transmitter
The Transmitter@_TheTransmitter·
Agentic coding makes it possible to specify a neuroscience model in hours instead of months, writes Brian DePasquale. The field risks becoming prolific but shallow—generating models faster than we can generate insights. thetransmitter.org/the-big-pictur…
English
2
7
17
2.4K
Andreas Tolias Lab @ Stanford University retweetledi
Surya Ganguli
Surya Ganguli@SuryaGanguli·
Our new paper lead by @vedanglad w/@AToliasLab "Letting the neural code speak..." arxiv.org/abs/2605.12485 We show how to get *monkey* visual neurons to TELL us in *human* language what images make them fire. We do this is an automated verifiable way at scale! How? 1) Build a digital twin of monkey visual areas that can accurately map visual inputs to neural activity. 2) Perform in-silico experiments on this twin to find many complex images that make a model neuron fire. 3) Use a vision-language model to describe these complex images. 4) Verification: use a language-conditioned diffusion model to generate new images, and check they make the monkey digital twin neurons fire a lot. To our knowledge, for the first time, we have a way to convert monkey vision to human language, and from *human* language to sample infinitely many images that make any given *monkey* visual neuron fire, all in an algorithmic fashion. For more exciting details, see @vedanglad's excellent thread!
Vedang Lad@vedanglad

How well can you describe the feature selectivity of a vision neuron … with words? Interpretability has long borrowed from neuroscience — and maybe it can give back too! 🧵

English
8
38
219
128.5K
Andreas Tolias Lab @ Stanford University retweetledi
Sophia Sanborn
Sophia Sanborn@naturecomputes·
🧠 Mechanistic interpretability for the brain 🧠 Early visual neurons have had a clean mathematical description for decades (Gabor functions), while higher visual areas have remained notoriously hard to characterize. Our new paper, led by @vedanglad, shows that natural language can provide that missing framework: concise, human-readable, verifiable descriptions of what higher visual neurons encode. To get there, we pair neural digital twins with vision-language models to run virtual neuroscience experiments at scale. Check out the full paper below.
Vedang Lad@vedanglad

How well can you describe the feature selectivity of a vision neuron … with words? Interpretability has long borrowed from neuroscience — and maybe it can give back too! 🧵

English
2
19
89
12.5K
Andreas Tolias Lab @ Stanford University
If you're at @CVPR this week, come meet the Metamorphic team. We're hosting a happy hour tomorrow evening with @SpiralDB on NeuroAI, AI for Science, and multimodal modeling — and we're hiring. Find @KonstantinWille and @AdrianoCardace there. 👇 metamorphic.com
Sophia Sanborn@naturecomputes

Metamorphic is at @CVPR this week. Join us tomorrow evening for a kick-off happy hour co-hosted with @SpiralDB to talk AI for Science, multimodal modeling, and what comes next. We’re growing the team - find @KonstantinWille and @AdrianoCardace there if you’re curious. luma.com/i4wjq5lu

English
0
2
8
1.7K
Andreas Tolias Lab @ Stanford University retweetledi
Radha Tripathi
Radha Tripathi@Radha_AI·
INSTEAD OF WATCHING AN HOUR OF NETFLIX TONIGHT. This 60-minute Cambridge lecture by Demis Hassabis will teach you more about the future of AI than most people will learn in the next 5 years. Bookmark it and give it an hour, no matter what.
English
22
460
2.6K
499.6K
Andreas Tolias Lab @ Stanford University retweetledi
Valerio Capraro
Valerio Capraro@ValerioCapraro·
Finally, a big name has the courage to tell it: we are nowhere near AGI. Demis Hassabis, CEO of Google DeepMind and Nobel laureate for AlphaFold, put it neat and clear: "Today's systems are nowhere near [AGI]. Doesn't matter how many Erdős problems you solve… I think it's far, far from what a true invention, or someone like Ramanujan, would have been able to do." This is the elephant in the room that many AI enthusiasts prefer not to see, or are actively trying to hide. Erdős problems are well defined, often combinatorial, on finite spaces. They are exactly the kind of problems on which current AI can achieve spectacular performance with a lot of compute and knowledge. A neural network can search a huge graph of possibilities. It can recombine existing knowledge at unprecedented scale. It can discover surprising solutions inside an already defined conceptual space. But true invention is something else. True invention is not only solving a problem. It is inventing new objects, new dimensions, new connections. It is inventing new problems. From resolving to inventing there is a discontinuity that we don't know how to bridge. We are making extraordinary tools. But we are nowhere close to AGI.
Valerio Capraro tweet media
English
288
426
2.2K
436.1K
Patrick Hsu
Patrick Hsu@pdhsu·
Thrilled to share I've started at @Stanford's Department of Pathology (@StanfordPath) in addition to @ArcInstitute. Looking forward to a shorter commute after 5 years at @BerkeleyBioE and embarking on daring new projects We're recruiting multiple postdocs and technical staff👇
English
30
32
647
53.3K
Andreas Tolias Lab @ Stanford University retweetledi
Demis Hassabis
Demis Hassabis@demishassabis·
I’ve always believed the No.1 application of AI should be to improve human health. That work started with AlphaFold, and now at @IsomorphicLabs with the mission to reimagine drug discovery and one day solve all disease! We are turbocharging that goal with $2.1B in new funding.
English
725
2.6K
21.2K
3.2M
Andreas Tolias Lab @ Stanford University retweetledi
Goodfire
Goodfire@GoodfireAI·
Neural networks might speak English, but they think in shapes. Understanding their rich *neural geometry* is key to understanding how they work – and to debugging and controlling them with precision. Starting today, we’re releasing a series of posts on this research agenda. 🧵
English
311
1.7K
11.3K
3.3M
Andreas Tolias Lab @ Stanford University retweetledi
Patrick Mineault
Patrick Mineault@patrickmineault·
Underlying all neurogenerative diseases is the general process of aging. We must strike at the root! In the short term, we should restore the health of the support systems of the brain. In the long term, we must build discovery platforms that fully capture human biology.
Patrick Mineault tweet media
English
6
16
91
5.8K
Andreas Tolias Lab @ Stanford University retweetledi
Roan
Roan@RohOnChain·
Anthropic pays $750,000+ a year for engineers who can build LLM architectures from scratch. Stanford taught the entire thing in 1 hour lecture & released it for free. Bookmark & watch this today before someone takes it down.
English
115
1.6K
10.4K
2.6M