System Intelligence

I’m excited to introduce the System Intelligence project which aims to build a future where advanced AI can design, implement, and operate next-generation computing systems. To realize this vision, we must unlock AI's next stage of capabilities – reasoning about architectures and protocols, weighing tradeoffs, applying enduring principles, developing effective abstractions, and more – beyond coding and bug fixing. We share our efforts on defining System Intelligence and our perspective on how to realize it in a recent SIGOPS Blog (sigops.org/2025/defining-…). We regard benchmarks as an initial foundation, and have been developing a System Intelligence Benchmark. We’d love to hear your feedback and look forward to your contributions! 🌐 Website: sys-intelligence.github.io 🛠️ GitHub: github.com/sys-intelligen…!

@tianyin_xu @FelxFeng @MSFTResearch @siebelschool A very exciting deep dive from @SysIntelligenc on what System Intelligence means and how we can meaningfully measure it. Excited to see the community pushing forward on these benchmarks!

Yes. Benchmark is essential starting point. We build a System Intelligence Bench (github.com/sys-intelligen…). We welcome community contributions to enrich existing benchmarks, port your existing benchmarks, and more importantly to create new system intelligence benchmarks with our framework.

Benchmarks are crucial to realizing the benefits of ADRS!