Jascha Achterberg

831 posts

Jascha Achterberg banner
Jascha Achterberg

Jascha Achterberg

@achterbrain

Co-Founder at @CallosumAI & Fellow of @StJohnsOx @UniofOxford. Working on understanding intelligent systems in neuroscience & building them in computing and AI.

London, UK Katılım Ocak 2015
1K Takip Edilen1.7K Takipçiler
Sabitlenmiş Tweet
Jascha Achterberg
Jascha Achterberg@achterbrain·
We are at a unique moment in time for AI & compute: New accelerators / chips, HPC hardware, and new algorithms have each made strides, but we are not yet orchestrating them as a heterogeneous stack. That is what @CallosumAI is built to do, and today we are sharing our vision 🧵
Callosum@CallosumAI

Today we launched @CallosumAI. We are building the infrastructure where heterogeneous chips & intelligence co-evolve to solve the world's hardest problems. Today we present our first results. Across four large problem spaces, we break SOTA and deliver orders-of-magnitude improvements in capabilities, cost and speed: 12× cheaper deep context. New web SOTA with open-source, 3x cheaper and faster. 2.4× cache speedups. 1,767× faster tool calling. This is the worst our infrastructure will ever be. We do it by co-evolving heterogeneous chips and multi-agent intelligence - workflows aware of their hardware, models aware of their task graph, kernels aware of their output constraints. An Intelligent System. callosum.com/blog/welcome-h…

English
5
9
29
3.6K
Jascha Achterberg retweetledi
Sean Escola
Sean Escola@SeanEscola·
We know about cosmological dark matter despite being unable to measure it because, without it, galaxies would fall apart. By analogy, let's talk about "cognitive dark matter" (CDM): brain functions that meaningfully shape behavior but are hard to infer from behavior alone. New paper! 🧵👇
English
4
17
75
13.9K
Jascha Achterberg retweetledi
Claire Bedbrook
Claire Bedbrook@clairebedbrook·
Aging may feel gradual… but what if it’s not? In our paper out today, we tracked fish continuously from puberty until death. This gave us a unique view of how aging unfolds across the adult lifespan. 🧵
English
21
144
551
67.4K
Jascha Achterberg retweetledi
Andrew Davison
Andrew Davison@AjdDavison·
I'm not sure about the details but I'm convinced that how to publish and create impact is due to change very significantly in the near future. The value of writing and reading 8 page PDFs is rapidly dropping. What is the right way to publish the nugget of a research contribution?
Jon Barron@jon_barron

If I was a grad student today, I would: 1) Not write papers, 2) push my (agent-written) code to a public repo ~weekly, 3) maintain (via agents) a writeup.tex (manually verified) and a skill.md in the repo, and 4) work towards establishing skill usage as the new "citation" format.

English
12
15
125
21.3K
Jascha Achterberg retweetledi
Andrew Hart
Andrew Hart@AndrewHart·
The UK gov just said they're investing £500m in AI startups. And they launched a 🔥 new website which celebrates british innovation, from the first algorithm to AlphaFold.
Andrew Hart tweet mediaAndrew Hart tweet mediaAndrew Hart tweet mediaAndrew Hart tweet media
English
15
60
459
20K
Jascha Achterberg
Jascha Achterberg@achterbrain·
@rajathx I don’t think the room is equipped for that but I will get back to you here if I hear there are recordings!
English
1
0
2
64
rajath
rajath@rajathx·
@achterbrain are there any recordings? would have loved to listen in
English
1
0
0
66
Jascha Achterberg
Jascha Achterberg@achterbrain·
Going to Cosyne? There will be a "Biologically-inspired Artificial Intelligence: Challenges and Opportunities" workshop on Monday 16th! 🧠 Exciting lineup of speakers alongside the opportunity to present your NeuroAI poster, more info on program & poster signup in thread below!
Jascha Achterberg tweet media
English
4
7
38
1.9K
Jascha Achterberg
Jascha Achterberg@achterbrain·
Super looking forward to the workshop! Alongside the talks and poster session, we are also working on an industry careers in NeuroAI meet-up for Early Career Researchers. All details and updates can be found on our website: sites.google.com/view/cosyne-ne…
English
0
0
2
115
Jascha Achterberg
Jascha Achterberg@achterbrain·
We are also hosting a NeuroAI poster session during the lunch break! If you are presenting a NeuroAI-related poster at Cosyne, you are welcome to put it up in our workshop room so attendees can find relevant work they might otherwise have missed. Signup: forms.gle/kzefm2FtVuRkou…
English
1
0
2
121
Jascha Achterberg retweetledi
Ian Hogarth
Ian Hogarth@soundboy·
Dario: "We find that actually using different chips is useful to us. Chips aren't just a speed number — we gain benefits from heterogeneity" - huge endorsement of @CallosumAI's core vision
Apoorv Agrawal@apoorv03

Dario at MS TMT Conference today: On defense / DOW:"We really believe in defending America." Anthropic has been working with the national security community for 2 years. "We are the most lean forward." On AI acceleration:"We do not see hitting a wall. This year will have a radical acceleration that surprises everyone." Exponentials catch people off guard. "We are at the precipice of something incredible. We need to manage it the right way." On where markets are wrong:"It's already big and it will get 1 million times bigger." The underestimation of exponential growth is the key thing people need to understand. On revenue scale:Anthropic was at ~$100M run rate 2 years ago. Now at $19B run rate. On culture — Dario says he spends 40% of his time on it:"Anyone who is CEO of a growing firm needs to realize they are chief culture officer. My job is to make sure everyone is on same page and believes in what we are doing. That's the most important thing." He does a vision quest with the whole company every couple weeks. "I want them to hear it directly from me. If I tell the CTO, who tells the VP Eng, who tells the manager — that's too long of a game of telephone." "Politics and infighting are a cancer to companies as they grow." On talent retention vs Meta:"We lost 2 people to Meta. They lost several dozen. Normalized by size, they lost 10-20x more people vs us." Attributes this to unified culture generating "super linear returns — by working together vs working against each other." On code as the breakout use case:Code has "exceeded our high expectations." Why? Devs adopt fast, code is verifiable, and gains compound — you build software to build software. "Didn't realize it would go so fast even at traditional enterprises." Frustration is around regulated industries where legal/compliance slow things down. "That's how fast everything could be going if not for non-AI barriers." On Anthropic's own AI usage:Top internal use cases: 1) writing code, 2) the process around writing code (SWE), 3) managing servers and controlling clusters. "If we were paying ourselves for our usage, we'd be one of our largest customers." On Claude Code:"You can supervise an army of 100 Claudes. It's closely analogous to a management skill." The people who are best at it keep the big picture in their head. Higher return to finding people who can handle more complex tasks. On platform vs apps:"We are primarily a platform, but there are places where we have expertise to make something directly useful." Claude Code emerged as a tool they built for themselves — thousands of internal users before shipping it externally. "Code is a prelude for what we will see in everything else." On societal implications:"Human history — lots of muddling through. We found ourselves in this comedy of errors and figured it out eventually. It's happening so fast that we need to do better than that this time." The market will deliver positive benefits — "I see that as priced in." What's not priced in: the choices we make around externalities. Jobs, national security, ensuring the benefits reach everyone. On chips & compute:Anthropic uses multiple chip suppliers. "We find that actually using different chips is useful to us. Chips aren't just a speed number — we gain benefits from heterogeneity." Also standard business logic of having more than one supplier.

English
1
2
15
3.1K
Jascha Achterberg
Jascha Achterberg@achterbrain·
@PessoaBrain @DanAkarca @CallosumAI Thank you so much Luiz! It were discussions like the ones we had when you visited Cambridge (and when this place still had computational neuro discussion...) that fed into the systems-level perspective that we are working on -- so, very grateful for that!
English
2
0
1
45
Jascha Achterberg
Jascha Achterberg@achterbrain·
@DanAkarca and I are reimagining how we can build and understand intelligent systems across cognition, algorithms, and circuits! Will post more thoughts later on our vision later, for now, please check out @CallosumAI !
Callosum@CallosumAI

The future of compute & AI is heterogeneous. That future is being built by Callosum. Today we launch with new breakthroughs made possible by heterogeneity, new scaling principles & a roadmap reimagining compute & AI infrastructure: callosum.com/blog/introduci…

English
1
1
12
554
Jascha Achterberg
Jascha Achterberg@achterbrain·
We are at a unique moment in time for AI & compute: New accelerators / chips, HPC hardware, and new algorithms have each made strides, but we are not yet orchestrating them as a heterogeneous stack. That is what @CallosumAI is built to do, and today we are sharing our vision 🧵
Callosum@CallosumAI

Today we launched @CallosumAI. We are building the infrastructure where heterogeneous chips & intelligence co-evolve to solve the world's hardest problems. Today we present our first results. Across four large problem spaces, we break SOTA and deliver orders-of-magnitude improvements in capabilities, cost and speed: 12× cheaper deep context. New web SOTA with open-source, 3x cheaper and faster. 2.4× cache speedups. 1,767× faster tool calling. This is the worst our infrastructure will ever be. We do it by co-evolving heterogeneous chips and multi-agent intelligence - workflows aware of their hardware, models aware of their task graph, kernels aware of their output constraints. An Intelligent System. callosum.com/blog/welcome-h…

English
5
9
29
3.6K
Jascha Achterberg retweetledi
Alex Chalmers
Alex Chalmers@chalmermagne·
I met @DanAkarca last year for what was meant to be a quick intro, but which then turned into probably the most interesting conversation I’ve ever had about compute. Think this is going to be very exciting!
Callosum@CallosumAI

The future of compute & AI is heterogeneous. That future is being built by Callosum. Today we launch with new breakthroughs made possible by heterogeneity, new scaling principles & a roadmap reimagining compute & AI infrastructure: callosum.com/blog/introduci…

English
2
4
19
4K
Jascha Achterberg
Jascha Achterberg@achterbrain·
This is the journey Dan and I are so excited about. A journey that will lead us to both understanding and building truly intelligent systems. Follow along and be part of what comes next: @CallosumAI
English
1
0
3
111