Christopher De Sa

See everyone at MLSys 2025 in Santa Clara next week! Super excited to organize the Young Professional Symposium program on day one (May 12) and our invited speakers @soumithchintala (keynote), @Tim_Dettmers, @infwinston, @simran_s_arora, @BeidiChen!

@annabelle_cs @GongAlbert @AShettyV @raazdwivedi Inspired by the groundbreaking work of @insu_han @daliri__majid @aminkarbasi @WentaoGuo7 @chrismdesa @afedercooper @cdomingoenrich

We're thrilled to announce the keynote speakers for #MLSys2025: @AnimaAnandkumar, @soumithchintala, Ling Liu and @istoica05! Registration is open to attend the conference in Santa Clara.

Learn more about the latest advances in AI and systems, including LLM serving, efficient attentions, structured outputs, scaling up training, and more topics. Check out #MLSys2025. Accepted papers at mlsys.org/virtual/2025/p… and register today at mlsys.org/Register

🦙QTIP 2, 3 and 4 bit Llama 3.3 models are now up on HF: huggingface.co/collections/re…. Almost no zeroshot degradation at all sizes. 2 bit QTIP 3.3 70B fits on a single 4090 and gives pretty high quality generations (📹).

🧵 🏎️ Want faster, better quantized LLMs? Introducing QTIP, a new LLM quantization method that achieves a SOTA combination of quality and speed – outperforming methods like QuIP#! 🧑‍💻+🦙(w/ 2 bit 405B!): github.com/Cornell-RelaxM… 📜arxiv.org/abs/2406.11235

MLSys 2024 is next week. Looking forward to seeing you all in Santa Clara! mlsys.org/Register

🚀🌟🚀Excited to announce Samba-CoE v0.2, which outperforms DBRX by @DbrxMosaicAI and @databricks, Mixtral-8x7B from @MistralAI, and Grok-1 by @grok at a breakneck speed of 330 tokens/s. These breakthrough speeds were achieved without sacrificing precision and only on 8 sockets, showcasing the true capabilities of dataflow! Why would you buy 576 sockets and go to 8 bits when you can run using 16 bits and just 8 sockets. Try out the model and check out the speed here - coe-1.cloud.snova.ai. We are also providing a sneak peak of our next model, Samba-CoE v0.3, available soon with our partners at @LeptonAI. Read more about this announcement at sambanova.ai/blog/accurate-…

New this year, there will be a Young Professionals Symposium on Monday, which provides a forum for young professionals in industry and academia, to discuss important research & career questions/challenges: abstract submissions are now open (sites.google.com/view/mlsys24yps).

This year’s conference will be held at the Santa Clara Convention Center, from Mon May 13th through Thu the 16th, and features keynote speakers: Yejin Choi (University of Washington/Allen Institute for AI), Jeff Dean (Google), and Zico Kolter (CMU/Bosch Center for AI).

We are excited to announce the technical program for MLSys 2024! The provisional set of accepted papers is now available on the website at mlsys.org/Conferences/20…. Register for MLSys now at mlsys.org/Register/

We are excited to announce this year’s keynote speakers for #MLSys2024: Jeff Dean @JeffDean, Zico Kolter @zicokolter, and Yejin Choi @YejinChoinka! MLSys this year will be held in Santa Clara on May 13–16. More details at mlsys.org.

🧵 (1/n) 👉 Introducing QuIP#, a new SOTA LLM quantization method that uses incoherence processing from QuIP & lattices to achieve 2 bit LLMs with near-fp16 performance! Now you can run LLaMA 2 70B on a 24G GPU w/out offloading! 💻 cornell-relaxml.github.io/quip-sharp/

MLSys 2024 call for papers is out. The submission deadline is Friday, October 27, 2023. mlsys.org/Conferences/20…

Christopher De Sa and Yucheng Lu won an Outstanding Paper Award Honorable Mention at the 2021 International Conference on Machine Learning (ICML) for "Optimal Complexity in Decentralized Training.” @chrismdesa @yuchengthekid cs.cornell.edu/information/ne…

Cornell computer science professor Kavita Bala, a leading expert in computer graphics and computer vision, has been named dean of the Faculty of Computing and Information Science. @CornellCIS news.cornell.edu/stories/2020/0…

Differentiating through the Fréchet Mean A Lou, @isaykatsman, Q. Jiang, @SergeBelongie, S. Lim, @chrismdesa arxiv.org/abs/2003.00335

Schools are shutting down today, but childcare is still a collective social responsibility. I've spent the last few days working with a crack team of coders to build this (incredibly cool) tool for scheduling MICRO childcare co-ops childcarecoop.org