
Adam Marblestone
9.9K posts

Adam Marblestone
@AdamMarblestone
Technologist, Scientist Co-founder and CEO @Convergent_FROs Tweets do not represent employers





1/8 Can AI help us disagree better? Today we're launching Habermolt — a platform where your AI agent learns your views and deliberates with others on your behalf. habermolt.com 🦞 🧵








So, some people are asking me why this EON fly video doesn’t show real ‘uploading’ since it does simulate a real connectome. The most important reason is that the functional parameters that define the dynamic behavior of individual neuron and synapse types in the connectome are unknown. Instead, they used an existing model (nature.com/articles/s4158…) which substitutes these with guessed parameters and grossly simplified dynamics. As made clear in that older paper, these are not sufficient to recreate the activity patterns that would be seen in the real fly. The simplified dynamics would not, for example, be able to choreograph the timing of leg muscles during walking or grooming, or the dynamics of the compass neurons encoding the fly’s heading direction, or the myriad other neuronal dynamics that make up the fly ‘mind’. So not an ‘upload’ by any reasonable definition. In fact, the simplified dynamics they used have only been demonstrated to approximate gross correlations along major sensory-motor pathways for a handful of neurons. For example: activating a sugar sensing neuron causes gross downstream activation that elevates the activity of feeding neurons. It is this handful of very, very crude and basic correlations in the simulated connectome that are being used to drive the EON simulated fly. If they had said that from the start, then I would have had no issue. But instead, they made the bold claim that they had “uploaded a fly” and presented a video of said fly walking over a landscape with highly articulate legs, visually navigating through the terrain to a food source, grooming its antenna with eerily fly-like leg motions, etc. Any reasonable layperson would assume that these visually exciting articulations are the ones being controlled by the simulated brain’s dynamics instead of being faked by computational add-on routines. There are now many secondary reports of this on YouTube and all of them seem to make this reasonable assumption (e.g. youtube.com/shorts/Z7NNP1Z…). And who could blame them? Many neuroscientists also made that assumption before EON started to spell out what was really behind the video millions of views and over a day later. To make clearer just how misleading EON Systems’ video is and how outlandishly laughable their ‘uploading’ claim is, below is an imagined back-and-forth discussion between a [Reasonable Layperson] and a [Neuroscientist] trying to explain to them what is really behind the video: [Reasonable Layperson] “Look at the complicated leg motions as the fly walks… the timing of all those dozens of individual muscles being controlled by the dynamics of the simulated neurons… and they say that they used no reinforcement learning to tune parameters, just the connectome… that is really impressive!” [Neuroscientist] “Well actually no… those leg movements are actually coming from a program unrelated to the connectome. The connectome used didn’t even include the central pattern generator circuits in the ventral nerve cord responsible for controlling leg muscles.” [Reasonable Layperson] “Oh… so in what sense is the simulated connectome controlling walking?” [Neuroscientist] “It looks like they just found a few neurons in the brain connectome that are correlated with right/left/forward motion and used these to ‘steer’ the pretend walking routine.” [Reasonable Layperson] “Oh… But the activations of those ‘steering’ neurons are reflecting the complicated dynamics of tens of thousands of simulated neurons in the fly visual system as it moves through the virtual world, avoiding objects and heading toward its visual goal, right?” [Neuroscientist] “Well actually no … The visual system and virtual world are essentially ‘decoration’… the flashing dynamic neural responses as the fly moves through the virtual environment are designed to give the viewer the impression that the simulated fly is actually seeing the world and making walking decisions based on those visual responses. But, in fact, they could turn off the lights and the fly would behave identically.” [Reasonable Layperson] “Oh… so how does the fly walk toward the food then?” [Neuroscientist] “Well… it looks like they simply imposed an odor gradient in the virtual environment that is centered on the virtual food. The fly has two sets of odor receptors (right and left) that sense this gradient and the activation of these in the connectome is correlated with the activation of the ‘steering’ neurons. So if the left odor neuron activates more than the right then the fly steers left.” [Reasonable Layperson] “Oh… so it is like one of those toy cars that moves toward a light because it has right and left light sensors cross-connected to right and left motors… Gee, I thought a fly was more complicated than that.” [Neuroscientist] “Well actually a real fly is. Real flies have dozens of behavioral states that allow intelligent behavior in a complicated visual and sensory environment. In fact, a real fly contains a set of neurons which act as an internal compass updated by the visual environment and the fly’s walking.” [Reasonable Layperson] “Oh… and their connectome has those internal compass neurons?” [Neuroscientist] “Yes. They used the full brain connectome that contains those compass neurons.” [Reasonable Layperson] “...And their compass neuron activations are tracking the visual environment just like in the real fly?” [Neuroscientist] “Oh sweet summer child… those compass neurons exist in their connectome simulation, but no one knows enough about their functional parameters (synaptic weights, time constants, etc.) to simulate them accurately. They light up in pretty patterns totally unrelated to how they would in a real fly walking through that visual world.” [Reasonable Layperson] “Oh… and the complicated leg movements it shows during antenna grooming… is that also just a faked recording?” [Neuroscientist] “Yes. All the complicated leg motions shown during grooming are faked by a hard-coded program. But they turn that fake routine on or off by looking at some neurons in the connectome that are correlated with actual grooming behavior triggered by dust accumulation on the antenna… well really they fake the dust too by just activating a set of neurons after a delay.” [Reasonable Layperson] “And what did EON Systems do? Did they acquire the connectome? Did they determine the neurotransmitter types? Did they do the calcium imaging experiments to determine the steering and grooming neurons? Did they make the mechanical fly model?” [Neuroscientist] “No. Those were all done by real labs who were kind enough to carefully write up their results in open journals and to post their results and code openly online…. It looks like Eon Systems just took their code and put it together with a virtual environment designed specifically to trick viewers by triggering behaviors in misleading ways.”


The conceptual and technical challenges are large, and it will be years before they are solved. We hope this research will help increase our knowledge of learning in living organisms and help build safer and more robust AI systems.


How do cell types relate to function? Prodded by @AdamMarblestone's recent appearance on @dwarkeshpodcast, I break down the logic of Steve Byrnes' theory of the steering vs. learning subsystem, and answer why many cell types are better than few for instincts and primary rewards.

Calling all AI4Science Model builders! Announcing OpenADMET's 3rd Blind Challenge: Predicting PXR Induction We are releasing the largest self-consistent datasets on PXR induction and producing 110 new structures of PXR-ligand complexes. Details 👇 1/2

American science is losing its edge because we don’t take the bold bets necessary for modern breakthroughs. Spoke with @NIHDirector_Jay about new opportunities to accelerate scientific innovation:



Four years ago, I started @PopVaxIndia with no real knowledge of biology and <$50k in personal funding, convinced that the combination of generative AI for design & RNA for delivery would unlock a new class of vaccines & therapeutics against diseases resistant to legacy methods.





Extremely cool (literally, but don’t worry the energy nets out very well), just super(conducting), and great to see Jeff helping the universe fulfill its cosmic destiny (as he wrote about here: arxiv.org/abs/1912.06518)



1. Superconducting Josephson junctions for computation: circuits behave like neurons, w/ near-zero energy dissipation, operating at cryogenic temps. 2. Single-photon optical interconnects: communication at physical limits of speed and energy efficiency. 3. Co-located memory & processing overcoming von Neumann bottleneck.


