Sabitlenmiş Tweet
Bri
19.9K posts

Bri
@christopher777
One who enjoys the challenge of creatively overcoming and circumventing limitations. Voir les choses comme elles sont vraiment / Red Team / Glitch at will
Manila, Philippines Katılım Haziran 2008
5.2K Takip Edilen1.7K Takipçiler
Bri retweetledi

MIT proved every major AI model is secretly converging on the same "brain."
It’s called the “platonic representation hypothesis,” and it’s one of the most mind-blowing papers you’ll ever read.
You train a vision model purely on images. You train a language model purely on text.
They use completely different architectures. They process completely different data. They should have completely different "brains."
But as these models scale up, something impossible is happening.
When researchers measure how they organize information, the mathematical geometry is identical.
A model that only "sees" images and a model that only "reads" text are measuring the distance between concepts in the exact same way.
The models are converging.
The researchers named this after Plato’s Allegory of the Cave.
Plato believed that everything we experience is just a shadow of a deeper, hidden, perfect reality.
The paper argues that AI models are doing the exact same thing.
They are looking at the different "shadows" of human data, text, images, audio. And they are independently discovering the exact same underlying structure of the universe to make sense of it.
It doesn't matter what company built the AI.
It doesn't matter what data it was trained on.
As models get larger, they stop memorizing their specific tasks. They are forced to build a statistical model of reality itself.
And there is only one reality to map.
2024, Arxiv

English

