We had our AI Infra meetup in San Francisco last week, co-hosted with @CrusoeAI and @lmsysorg. We've put the slides from each talk below so you can go through the material at your own pace. 👇 🧵 1/10

@thu_yushengsu, the founding member at @radixark and a core contributor to @lmsysorg SGLang, gave a talk on the efficiency and determinism in large-scale RL training using the Miles framework. GitHub repo: github.com/radixark/miles Slides: docs.google.com/presentation/d… 🧵 2/10

Connor Guerrero, the founding member of @CrusoeAI's developer relations team gave a talk on serving LLMs on Crusoe with KServe. Tutorial: crusoe.ai/resources/blog… Slides: drive.google.com/file/d/1ERlUUu… 🧵 3/10

Tanmay Chopra, the founder of @withemissary, gave a talk on post-training LLMs beyond weights. Slides: drive.google.com/file/d/1a9DUMF… 🧵 4/10

DJ Gianduso, the product lead at @makora_ai, gave a talk on generating GPU kernels to improve inference performance. Slides: drive.google.com/file/d/1mbthno… 🧵 5/10

@andrey_cheptsov, the founder of dstack, gave a talk on building a new orchestration standard for AI infrastructure across hardware, cloud, and software vendors. GitHub repo: github.com/dstackai/dstac… Slides: drive.google.com/file/d/1lfmxIf… 🧵 6/10

Tanya Verma, a co-founder of @TinfoilAI, gave a talk on verifiably private AI and confidential inference with secure hardware enclaves. 🧵 7/10

@KonstantinWille, the brain modeling lead at Metamorphic, gave a talk on the Enigma project at @Stanford building the foundation for the next generation of foundation models. Slides: drive.google.com/file/d/1_xWgmg… 🧵 8/10

We thank everyone who joined the meetup and especially our co-hosts @CrusoeAI and @lmsysorg. We're already working on the next AI Infra Meetup. See you at the next one! 🧵 9/10

If you’re interested in an open-source orchestration platform that simplifies training and inference across GPU vendors, clouds, and open-source software stacks, check out our GitHub repo: github.com/dstackai/dstac… 🧵 10/10