Chris Gottbrath

PyTorch 2.12 introduces major updates across compilation, export, distributed training, and accelerator support. Highlights include up to 100x faster batched linalg.eigh on CUDA, the new torch.accelerator.Graph API, Microscaling quantization support in torch .export.save, and fused Adagrad. The release includes 2,926 commits from 457 contributors since PyTorch 2.11. Have questions? Join @AndreyTalman (@Meta), @albanDesmaison (@Meta), and @joespeez (@reflection_ai), moderated by @Chris_AI_HPC (@Meta), on May 20 at 10:00 AM PT for a live Q&A covering the release and answering questions from the community. 🔗 Read the release blog and register for the webinar: pytorch.org/blog/pytorch-2… #PyTorch #OpenSourceAI #MachineLearning #AIInfrastructure

@PyTorch @Nvidiadev @matthew_d_white @narendasan @PKUWZP @robertnishihara @_seemethere @mr_purelycloud @alband @malfet @joespeez @ptrblck_de @syedahmedz Come by the Meta PyTorch booth at GTC today if you want to learn about any of these topics.

@Nvidiadev @matthew_d_white @narendasan @PKUWZP @robertnishihara @_seemethere @mr_purelycloud @alband @malfet @joespeez @ptrblck_de @syedahmedz 1PM: Join the Ecosystem w/ Alban Desmaison 2PM: Start Contributing w/ Alban 3PM: CuteDSL CUDA Kernels w/ Vicki Wang, Manas Sahni 4PM: SGLang Inference w/ Baizhou Zhang, Hao Lu 5PM: Monarch Framework w/ Ali Sol, Saurabh Mishra 6PM: TorchComms w/ Davide Italiano, Matthias Reso

Heading to #NVIDIAGTC next week? Let’s talk @PyTorch. 🚀 We’re bringing the community to San Jose. Drop by Booth #338 to meet expert developers and core maintainers in person. Scaling, inference, foundation models, and OSS contributions. Full schedule below 👇 #PyTorch

🗓️ TUESDAY @ Booth #338 12PM: Wheel Next w/ @_seemethere 1PM: OpenEnv w/ Ali Sol & @mr_purelycloud 2PM: Core Maintainer Office Hours w/ @albanD @malfet @joespeez @ptrblck_de 3PM: Titan & Forge w/ @syedahmedz, Davide Italiano, Kai Wu 4PM: Ambassador Program w/ @matthew_d_white 5PM: vLLM Inference w/ @woosuk_k

@Nvidiadev 🗓️ MONDAY @ Booth #338 2PM: Shaping the Future w/ @matthew_d_white 3PM: TensorRT + PyTorch w/ Angela Yi & @narendasan 4PM: DeepSpeed Trillion-Param Training w/ @PKUWZP 5PM: PyTorch Export w/ Angela Yi 6PM: Ray Distributed Computing w/ @robertnishihara #AI #GTC2025

If you are at GTC and you care about AI Frameworks, don't miss your chance to talk with the PyTorch experts at the booth. We have a packed schedule experts on different topics available for you to meet at booth #338.

@PyTorch I am looking forward to this event and seeing PyTorch users and contributors from across the AI industry.

PyTorch 2.10 is now available, with updates focused on performance, determinism, and numerical debugging for modern training and post-training workflows. Highlights include Python 3.14 support for torch.compile(), reduced kernel launch overhead in TorchInductor, a new varlen_attn() op for variable-length sequences, and improved tools for tracking numerical divergence. 🖇️ 🔥 Read the PyTorch 2.10 release blog and release notes: hubs.la/Q03_NHfT0 #PyTorch #OpenSourceAI #AIInfrastructure

🚀 Join PyTorch Compile H2, 25 Roadmap Q&A! 📅 Sep 3, 25 | ⏰ 9AM PST 📌 RSVP & Submit Questions: docs.google.com/forms/d/15RBPE… 📍 Location: fb.zoom.us/j/99817055012?… 📜 Roadmap: dev-discuss.pytorch.org/t/meta-pytorch… Hear from the leads, ask questions, & help shape the future of PyTorch Compile.

Sharing a little of what I have been up to recently (I help organize collaborative roadmap process for the PyTorch team at Meta) -- I've done a lot of roadmaps in my career and I like the way PyTorch does it best.

Introducing ExecuTorch Alpha ⚡ ExecuTorch Alpha is focused on deploying large language models and large ML models to the edge, stabilizing the API surface, and improving installation processes. Learn more in our latest blog: hubs.la/Q02vzrrW0

Announcing the alpha release of torchtune! torchtune is a PyTorch-native library for fine-tuning LLMs. It combines hackable memory-efficient fine-tuning recipes with integrations into your favorite tools. Get started fine-tuning today! Details: hubs.la/Q02t214F0

Training a model (not something I do all that much these days) and feeling like myself in grad school "my computer is working hard on physics calculations therefore I am working hard, right?"

I just learned (rather belatedly) of Rusty's passing. He was a well known figure in HPC and just a great person to interact with. He'll be missed.

Excited to see PyTorch taking on a structure that will help it continue to grow and scale.

@parry_hailey Congratulations!

Successfully passed my defense! Hailey Parry, PhD

Introducing torch.profiler! New PyTorch Profiler collects both GPU and framework related info, correlates them, performs automatic detection of bottlenecks in the model, generates recommendations on how to resolve these bottlenecks, and visualize. Read 👉pytorch.org/blog/introduci…

PyTorch 1.8 supports ROCm wheels, providing an easy onboarding for using AMD GPUs. You can simply go to the standard PyTorch installation selector and choose ROCm as an installation option and execute the provided command. Learn more below: pytorch.org/blog/pytorch-f…

@marksaroufim @PyTorch @Facebook Welcome!

@JPMajor wow!

Check out these rock structures in Gale Crater! A bit less gravity, thin atmosphere, literally zero rain and LOTS of time... (Credit: NASA/JPL-Caltech/MSSS)

@elakdawalla great thread. Thanks for sharing. I have been thinking a but lately about fairness in how we evaluate, provide feedback, and reward folks and I wish more folks talked about this kind of thing in this way.

The reason I had a bad day today is a little bit my fault and a little more somebody-else-who-was-having-a-bad-day’s-fault and a little more patriarchy’s fault and I’m doing better now so I thought I’d write about it to illustrate some of the catch-22s of professional life.