Paul

I wrote a matmul kernel on B200 in pure CUDA/PTX that beats cuBLAS by 6% at M=N=K=8192. Inspired by @gaunernst's blog on Blackwell instructions with benchmarking done on @modal. Blog: paulwillchan.com/articles/outpe… Repo: github.com/Better-Call-Pa…

@clattner_llvm Would you consider something like cluster launch control to be micromanaging?

Pipelining AI kernels is required to get full perf/utilization out of modern chips. However, no one has been able to crack "full control over the hardware" without "having to micromanage it". Let's crack this open: kernel authors deserve a powerful scheduler they can control. 💪