Karen Schroeder
198 posts
@schroeder_ke
Operations @BasisOrg, building a new kind of research org. Neuroscientist and engineer 🧠🔧 AI, BCIs, comp neuro. @ https://t.co/oDAu03oqSL
Excited to release what we’ve been working on at Amaranth Foundation, our latest whitepaper, NeuroAI for AI safety! A detailed, ambitious roadmap for how neuroscience research can help build safer AI systems while accelerating both virtual neuroscience and neurotech. 1/N
Today we're announcing the winners of ARC Prize 2024. We're also publishing an extensive technical report on what we learned from the competition (link in the next tweet). The state-of-the-art went from 33% to 55.5%, the largest single-year increase we've seen since 2020. The benchmark remains unbeaten, but we're happy to see that research progress on the key bottleneck to AGIs (in particular on-the-fly adaptation to novel tasks) has been reignited in 2024 -- in part thanks to ARC Prize. In particular the competition has popularized Test Time Training (TTT), originally pioneered for ARC-AGI by Jack Cole last year. I believe TTT represents the largest jump in LLM generalization capabilities since the initial findings regarding in-context-learning circa 2019-2020. ARC Prize has also led to a considerable surge of research interest towards program synthesis. Competition winners: 🥇 the ARChitects (Daniel Franzen, Jan Disselhoff) 🥈 @guille_bar 🥉 alijs (Agnis Liukis) Paper Award winners: 🥇 "Combining Induction and Transduction For Abstract Reasoning" by @xu3kev et al. 🥈 "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning" by @akyurekekin et al. 🥉 "Searching Latent Program Spaces" by @ClementBonnet16 & @MattVMacfarlane ARC-AGI-Pub Leaderboard (solutions using commercial APIs): 🥇 @jeremyberman 🥈 @ellisk_kellis & @akyurekekin 🥉 @RyanPGreenblatt
Proud to share that our work with @ellisk_kellis and collabs won the 1st prize ARC Paper Award! This is the first work to come out of the MARA project. Much more to come.
ARC Prize 2024 Paper Award Winners! 🏆 1st "Combining Induction and Transduction For Abstract Reasoning", @xu3kev, @HuLillian39250, Carter Larsen, Yuqing Wu, @simon_alford0, Caleb Woo, Spencer M. Dunn, @haotang_ai, Michelangelo Naim, Dat Nguyen, @WeiLongZheng1, @ZennaTavares, @evanthebouncy, @ellisk_kellis 2nd "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning", @akyurekekin, @MehulDamani2, @linluqiu, Han Guo, @yoonrkim, @jacobandreas 3rd "Searching Latent Program Spaces", @ClementBonnet16 & @MattVMacfarlane Runners Up - Daniel Franzen & Jan Disselhoff - "The LLM ARChitect: Solving the ARC Challenge Is a Matter of Perspective" @guille_bar - "Omni-ARC" @pfletcherhill - "Mini-ARC: Solving Abstraction and Reasoning Puzzles with Small Transformer Models" @simonouellette6 - "Towards Efficient Neurally-Guided Program Induction for ARC-AGI" @jfpuget - "A 2D nGPT Model For ARC Prize"
New ARC-AGI paper @arcprize w/ fantastic collaborators @xu3kev @HuLillian39250 @ZennaTavares @evanthebouncy @BasisOrg For few-shot learning: better to construct a symbolic hypothesis/program, or have a neural net do it all, ala in-context learning? cs.cornell.edu/~ellisk/docume…
@BasisOrg has started a joint project called MARA w/ @ellisk_kellis 's lab +others. This is our first output. More details soon. We're sponsoring "Systems 2 Reasoning at Scale" workshop at Neurips & will present MARA there. We're hiring for it now! #careers" target="_blank" rel="nofollow noopener">basis.ai/join-us/#caree…
New ARC-AGI paper @arcprize w/ fantastic collaborators @xu3kev @HuLillian39250 @ZennaTavares @evanthebouncy @BasisOrg For few-shot learning: better to construct a symbolic hypothesis/program, or have a neural net do it all, ala in-context learning? cs.cornell.edu/~ellisk/docume…
New ARC-AGI paper @arcprize w/ fantastic collaborators @xu3kev @HuLillian39250 @ZennaTavares @evanthebouncy @BasisOrg For few-shot learning: better to construct a symbolic hypothesis/program, or have a neural net do it all, ala in-context learning? cs.cornell.edu/~ellisk/docume…
