The Heavy Life

THE ENTIRE AI INDUSTRY JUST GOT HUMILIATED a tiny model trained in just a few hours on a single graphics card is planning 48x faster than billion-dollar supercomputers. It actually understands physics instead of just memorizing patterns. yann lecun was right the whole time for three years every major lab told you the same story. scale is all you need. just throw more GPUs at it. just train on more tokens. eventually the model will "wake up" and understand the world. it was a lie. or at minimum, a very expensive bet that just lost. LeCun kept saying generative AI is a dead end. predicting the next pixel or the next token is fundamentally wasteful, the model burns trillions of parameters memorizing surface details instead of learning how reality actually works. he proposed JEPA instead. predict abstract concepts in a compressed thought space. don't paint the world pixel by pixel, understand it. the problem was JEPA kept collapsing. left to its own devices the model would cheat, mapping a dog, a car, and a human to the same point in latent space. technically minimizes the loss. learns absolutely nothing. every fix was ugly. seven loss terms. frozen encoders. EMA tricks. stop-gradients. the kind of duct-tape engineering that should have been a red flag. then LeCun's team dropped LeWorldModel. they replaced all the hacks with one regularizer that forces the latent space into a gaussian distribution. the model can no longer cheat. to make accurate predictions it has to actually encode physics. 15 million parameters. single GPU. trains in hours. plans 48x faster than foundation world models. detects physically impossible events on its own. meanwhile OpenAI is raising another $40B to train GPT-6 on a data center the size of manhattan. the entire scaling thesis just got embarrassed by a model that fits on a gaming PC.

This is the single most genius diplomatic gesture I have ever seen.