Amanda H

7 posts

Amanda H

Amanda H

@Amanda__Hecker

Katılım Eylül 2023
26 Takip Edilen24 Takipçiler
Amanda H retweetledi
Boris Hanin
Boris Hanin@BorisHanin·
🚨 2026 @Princeton ML Theory Summer School 🔥 Learn from amazing researchers and meet your peers. Mini-courses by: - Subhabrata Sen @subhabratasen90 - Lenaic Chizat @LenaicChizat - Sinho Chewi - Elliot Paquette @poseypaquet - Elad Hazan @HazanPrinceton - Surya Ganguli @SuryaGanguli (to be confirmed) August 3 - 14, 2026 Apply by March 31, 2026. Link 👇 Sponsored by @NSF, @PrincetonAInews, @EPrinceton, @JaneStreetGroup, @DARPA, @PrincetonPLI, Princeton NAM, Princeton AI2, Princeton PACM
Boris Hanin tweet media
English
6
34
271
48.6K
Amanda H retweetledi
Beff (e/acc)
Beff (e/acc)@beffjezos·
EBMs are so back
Rohan Paul@rohanpaul_ai

Logical Intelligence introduces first energy-based reasoning AI Model, and brings Yann LeCun to leadership as founding chair of their Technical Research Board The 6-month-old Silicon Valley start-up, unveiled an “energy based” model called Kona and says it is more accurate and uses less power than large language models like OpenAI’s GPT-5 and Google’s Gemini. It is also starting a funding round that targets a $1bn-$2bn valuation and has named LeCun chair of its technical research board. Most large language models answer by predicting the next token, which can sound fluent while still drifting into confident mistakes. Kona is an "energy-based reasoning model" (EBRM) that verifies and optimizes solutions by scoring against constraints, finding the lowest "energy" (most consistent) outcome. It's non-autoregressive, producing complete traces without sequential generation, reducing hallucinations. Focuses on trustworthy, math-grounded reasoning for high-stakes applications where LLMs fail, emphasizing safety, efficiency, and constraint enforcement in logic-heavy tasks like puzzles or proofs. How Kona operates Its a non-autoregressive "energy-based reasoning model" (EBRM) model, meaning it doesn't generate outputs sequentially (like LLMs do token-by-token) but instead produces complete reasoning traces simultaneously. Here's how it works step-by-step: - Input Conditioning: It takes a problem, constraints, and optional targets (e.g., a desired outcome like a proof goal or spec) as inputs. These condition the model directly, unlike LLMs which rely on probabilistic sampling. - Energy Function Scoring: Kona learns an energy function that assigns a scalar "energy" score to entire reasoning traces (partial or complete). Low energy indicates high consistency with constraints and objectives; high energy flags inconsistencies, violations, or errors. This global scoring evaluates end-to-end quality, allowing the model to assess long-horizon coherence without degrading over extended traces. - Optimization as Reasoning: Reasoning is reframed as an optimization problem. The model searches for the lowest-energy solution by minimizing the energy function, often through iterative refinement. It can revise any part of a trace mid-process, using dense feedback to localize failures (e.g., "this step violates constraint X") and guide corrections. - Continuous Latent Space: Unlike discrete token-based LLMs, Kona works in a continuous space with dense vector representations. This enables precise, gradient-based edits and efficient local refinements without regenerating entire sequences. - Output: The final low-energy trace represents a valid, constraint-satisfying solution. For example, in Sudoku, it maps allowable moves and finds a puzzle completion that minimizes energy (i.e., maximizes rule adherence). This mechanism draws from physics-inspired principles, where energy minimization finds stable states, similar to how natural systems settle into low-energy configurations. Overall, Logical Intelligence views EBMs as a path beyond LLM limitations, enabling AI that "knows" rather than guesses, with applications in verifiable, efficient reasoning. This aligns with LeCun's long-standing advocacy for objective-driven AI via energy minimization, as opposed to autoregressive prediction.

English
12
7
242
27.3K
Amanda H retweetledi
Jared Quincy Davis
Jared Quincy Davis@jaredq_·
It's really important to actively advance positive themes around the impact of AI on civilization. Scientific and technological advance is important to the world; it renders things positive-sum. Efforts that apply AI to scientific endeavor are primarily expansionary (vertical), rather than replacement-oriented (horizontal). The "AI for Science" community is great and making a lot of exciting progress, so we're excited to help convene this symposium.
Mithril@mithrilcompute

Join the discussion w/leaders from academia, government, non-profits, industry Organized by @mlfoundry Co-sponsored by @InvTechInc, Open Athena, and Enigma Project 🧵Registration and more info below

English
1
4
16
1.9K
Amanda H retweetledi
Mithril
Mithril@mithrilcompute·
Networks of networks (NoNs), which compose many inference calls to multiple monolithic AI models, can significantly improve system accuracy for certain domains, particularly those requiring advanced reasoning. How, though, to compose these calls? What principles can we use to guide the composition of NoNs? Read the full paper from our founder and CEO @jaredq_ and co-authors @BorisHanin, @ChenLingjiao, @pbailis, Ion Stoica, and @matei_zaharia 👇 Arxiv: arxiv.org/pdf/2407.16831
Jared Quincy Davis@jaredq_

In this article, I and co-authors @BorisHanin, @ChenLingjiao, @pbailis, Ion Stoica, and @matei_zaharia explore one of the most powerful ideas we have yet discovered to inform compound AI systems design: verifiability. In common situations where practitioners are willing to expend a higher budget to go beyond the capabilities frontier accessible to today's state-of-the-art (SOTA) monolithic models, they may be willing to invoke many model inference calls, composing them into “networks of networks” (NoNs) of sorts. The question then becomes: what principles should guide the composition of these NoNs? Inspired by TCS and PCP notions that often verification is easier than generation (as holds for classical problems like graph coloring), we construct “best-of-K” or “judge-based” Compound AI Systems, which explicitly separate “generator” modules from “verifier” modules. We posit that these systems are particularly helpful for “reasoning-based” or “procedural-knowledge” oriented tasks, which are often more verifiable, less so for factual or declarative-knowledge settings (and we can use these systems partly to help characterize tasks, including subjects in the MMLU, along these lines). Very neatly, it turns out we can analytically characterize when these systems can confer a gain and predict the gain’s extent. We hope people will extend these ideas to tackle some of the reasoning-oriented application frontiers that are a bit beyond the range of today’s SOTA models. Arxiv: arxiv.org/pdf/2407.16831

English
0
4
9
1.7K