Rohit Agarwal
17 posts

Rohit Agarwal
@Rohit_Writes
CS PhD Student @ @PrincetonPLI | UC Berkeley EECS '24 I have a blog https://t.co/QbW8jD4apH








LLM training is built on fast MatMuls. But many surrounding ops still run as memory-bound kernels. CODA reparameterizes them to hide in the matmul’s shadow, fused into its epilogue before results leave the chip. Bonus: LLMs can write fast CODA kernels too (approaching SoLs).

If you are a mathematician, then you may want to make sure you are sitting down before reading further.




AI alignment is not only a reward-design problem; it is an incentive-design problem. In our new paper, we propose a strategic post-training signal for agentic AI pipelines, inspired by the economics of deterrence and enforcement. With my students @Rohit_Writes, @JoshuaLinML, and colleague Mark Braverman, link to paper:













