Sabitlenmiş Tweet

Introducing AoA (Agent over Abstract Syntax Trees), our proof agent built on Isabelle/HOL.
🎯 AoA achieves 99.6% on miniF2F, 89.2% on NTP4VC-Pearl, and 97.7% on NTP4VC-realC, while delivering a 2.3–4.7x reduction in API cost, a 2.9–6.9x reduction in token consumption, and 1.4–2.0x faster total execution time compared to Amazon's Isabelle Agent — which is likewise built on Isabelle and equipped with Sledgehammer.
These results are powered by two key innovations:
✨ AoA abstracts away from the concrete syntax of proof languages, representing proofs as abstract syntax trees via a JSON schema. This enables the first effective proof agent on a freshly redesigned language (Isabelle/Minilang) that commercial LLMs have had little exposure to — suggesting that the LLM era, far from stifling new languages, can actually accelerate their development.
✨ AoA also abandons the traditional agent interaction paradigm of source-code editing with line-number indexing, adopting a novel tree-editing model that eliminates the line-number drift issues that conventional agents often struggle with.
📄 Paper: arxiv.org/abs/2607.16372
🦾 Source code: github.com/xqyww123/Isa-M…
🙏 Huge thanks to my amazing co-authors @joshuaongg21 , @realReasonWang , @WendaLi8 , @haonanlp , Luke Ong, and @conrad_watt — it has been a true honor working with you all.


English

