GPU MODE retweetledi
English
GPU MODE
244 posts
GPU MODE
@GPU_MODE
Your favorite GPU community
gpumode.com Katılım Eylül 2024
12 Takip Edilen8.7K Takipçiler
Codex is so good at writing kernels that it felt appropriate to do a Codex only kernel competition. Metal is great because you'll be able to tangibly feel the perf improvements in your local models
Ben Burtenshaw@ben_burtenshaw
Humanity's Last Hackathon is NOW OPEN for registration. This is not a normal hackathon. You will be judged on the context, not the code! Use Codex @OpenAIDevs to build and optimize models for local inference (kernels on Max metal). Submit through @GPU_MODE. Climb the leaderboard. Top performers qualify for the final battle. Launches May 4th. Registration is live now.
English
GPU MODE retweetledi
Humanity's Last Hackathon is NOW OPEN for registration.
This is not a normal hackathon. You will be judged on the context, not the code!
Use Codex @OpenAIDevs to build and optimize models for local inference (kernels on Max metal). Submit through @GPU_MODE.
Climb the leaderboard. Top performers qualify for the final battle.
Launches May 4th. Registration is live now.
English
GPU MODE cited on @tbpn - thank you for the plug @AnushElangovan !!
We hope to continue making GPU programming more accessible to everyone!
TBPN@tbpn
AMD's @AnushElangovan explains why he thinks his company's open source ethos combined with agentic AI superpowers their leverage as a company: Because AMD publishes a lot of technical details about its hardware, when engineers use AI tools, the models already “understand” AMD’s systems and can help write code for them, debug them, or even generate new tools. And that makes developers more productive on AMD hardware without AMD having to do all the work internally. "AMD has had this ethos of open source, which really plays to our advantage. Every frontier model that I use has already seen every bit of AMD source code." "It'll rewrite my spec for me because it's already in the training data. Which you can't get from closed ecosystems." "In fact I built a virtual GPU simulator just based off our public specs, and now I'm running it on the GPU. So now I can run cross-generational GPU simulations on existing hardware." "We have that advantage. And we've run a Dev Day contest where we generated more tokens on AMD — Triton kernels and HIP kernels — than existed on the internet at the time." "So now that's all part of the pre-training data. It's a superpower because now you're open source, and you're agentically accelerating this process."
English
GPU MODE retweetledi
My colleagues Jack Carlisle and Jay Shah gave a fantastic lecture for @GPU_MODE yesterday on our categorical foundations for CuTe layout algebra! They were joined by Cris Cecka, the inventor of CuTe, and @marksaroufim as moderators. Bravi tutti!
youtu.be/MVh_guNbWMA?si…
YouTube
English
Jack Carlisle & Jay Shah talk on the Fundamentals of CuTe Layout Algebra. Special guest Cris Cecka
See you soon! youtube.com/watch?v=8QfQd8…
YouTube
English
GPU MODE retweetledi
our "@pleiasfr and friends" team got second place at the @GPU_MODE hackathon in Paris last week! 🥈
we had a lot of fun optimizing our training throughput, so trying out 8 bit training, muon, RoPE/NoPE, conv architectures, ... Basically nanogpt speedrunning on B300s.
Verda (formerly DataCrunch)@verdacloud
We’re sponsoring a @GPU_MODE hackathon in Paris on April 9, to conclude the PyTorch Conference Europe 🇪🇺 Our grand prize? 48 hours on GB300 NVL72. Join us with the teams behind @PyTorch, @PrimeIntellect, @SemiAnalysis_, @sestercegroup, and more! luma.com/gpu-mode-paris…
English
We're back on schedule Tuesday April 14 at 9am PST we'll have a talk from Andrei Panferov and Erik Schultheis on their improved recipe for nvfp4 pretraining. They'll cover both math and kernels youtube.com/watch?v=HB4up2…
YouTube
English
GPU MODE retweetledi
Incredible release
Alex Zhurkevich@cudagdb
Trtllmgen kernels are now open. Fastest prefill and decode kernels for our target workloads. We wrote these to win InferenceX, MLPerf, other benchmarks. Powering some of today’s top served models. Dive in, learn, use them, or level up your own. Enjoy. github.com/flashinfer-ai/…
English
GPU MODE retweetledi
GPU MODE retweetledi
GPU MODE (@GPU_MODE) & PyTorch Foundation are organizing an ML systems hackathon in Paris on April 9, immediately following PyTorch Conference Europe 2026.
Researchers and engineers will compete across two tracks:
-Distributed training (LLM speedrun) and inference optimization (leaderboard)
- Access to a B300 cluster from Verda and H200 instances from Sesterce
- Cloud credits as prizes, including 48-hour access to a GB300 NVL72 rack
- Talks from PyTorch (Helion), vLLM, Prime Intellect, and more
- Food and refreshments
Doors open at 9:30, with the closing ceremony at 20:00. Attendees can join with a pre-formed team or match on-site. Location details are shared upon registration.
Spots are limited. Register: luma.com/gpu-mode-paris…
#OpenSourceAI #PyTorchCon #PyTorch #vLLM #Helion
English
Closing up GTC week with one of favorite returning guests Kapil Sharma who will talking about how to learn CUTLASS the hard way youtube.com/watch?v=_ZOK0W…
YouTube
English
GPU MODE retweetledi
@marksaroufim @GPU_MODE @NVIDIAGTC
Award ceremony for the nvfp4 kernels.
Come hang out at GuildHouse!
English
GPU MODE retweetledi
What’s the best model you can train in a day if someone hands you a pile of Blackwell GPUs?
You can try out yourself
On April 9 in Paris, @GPU_MODE + @verdacloud + @sestercegroup are hosting a GPU hackathon with a bunch of GPUs to run on and even more of them for the winners.
English