Willy Chan

LLMs write fast single-GPU kernels. Ask for a multi-GPU one and they fall apart. ParallelKernelBench measures how they fail by benchmarking against 87 problems pulled from real codebases including Megatron-LM, DeepSpeed, DeepEP, TensorRT-LLM, NeMo-RL. New research from Willy Chan @asplencmnt @simonguozirui @simran_s_arora and @realDanFu

LLMs write fast single-GPU kernels. Ask for a multi-GPU one and they fall apart. ParallelKernelBench measures how they fail by benchmarking against 87 problems pulled from real codebases including Megatron-LM, DeepSpeed, DeepEP, TensorRT-LLM, NeMo-RL. New research from Willy Chan @asplencmnt @simonguozirui @simran_s_arora and @realDanFu

At #ICLR2026 🇧🇷 this week, learning Portuguese is way harder than learning a new programming language! 😅 On that note, come find me presenting some work on post-training and test-time bootstrapping for rare or domain-specialized 🦜code generation! ⚡ Kevin: Multi-Turn RL for Generating CUDA Kernels  Friday 3:15 PM – 5:45 PM, Pavilion 4-#5003 🐒 DSL-Monkeys: Self-Generated In-Context Examples for Low-Resource GPU DSL Kernels Data-FM (Sunday) and Test-Time Updates (Monday) Workshop Até lá!

Fresh blog post! @modal partnered with @ScalingIntelLab, @HazyResearch, and @chelseabfinn's IRIS Lab to speed up research on speeding up AI research. Read how scientists at the cutting edge are building the machines that build the machines with Modal. modal.com/blog/accelerat…