Gokhan Guner

If this Karpathy interview doesn't pop the ai bubble, nothing will. 10 brutal quotes: 1. LLMs don’t work yet They don’t have enough intelligence, they’re not multimodal enough, they can’t use computers, and they don’t remember what you tell them. They’re cognitively lacking. It’ll take about a decade to work through all of that. 2. When you boot them up, they always start from zero They have no distillation phase, no process like sleep where what happened gets analyzed and written back into the weights. 3. What’s stored in their weights is only a hazy recollection of the internet It's just a compressed blur of 15 trillion tokens squeezed into a few billion parameters. Their context window is just short-term working memory. 4. They’re good at imitation, terrible at going off the data manifold Too much memory, not enough reasoning. We need to strip away the memorized knowledge and keep the cognitive core: the algorithms, the magic of intelligence, problem-solving, strategy. 5. We’ve probably recreated a cortical tissue, pattern-learning and general, but we’re still missing the rest of the brain No hippocampus for memory. No amygdala for instincts. No emotions or motivations. 6. They memorize perfectly but generalize poorly If you give them random numbers, they can recite them back. No human can do that. That’s the problem: humans forget just enough to be forced to find patterns. 7. Anything truly new, code that’s never been written before, ideas that have no template; they stumble They’re still autocomplete engines with perfect recall and no understanding. Until we find that cognitive core, intelligence stripped of memory but full of reasoning, they’ll stay brilliant mimics, not minds.

Artificial General Intelligence emerges not from the LLM core itself, but from its modular expansion.