Renick Bell retweetledi
World models have existed for years (though not in LLMs); I take them to be explicit representation of objects, places, events, mechanisms etc you can reason over.
Chess computers have them (board, pieces, moves, history)
Nav systems have them (roads, times, etc)
Wikipedia has one of a sort (when people were born, where they died, etc)
They often work great (though again LLMs lack them).
But most are hand-engineered.
The trick is to acquire them from data.
Fer Cuadra 🇦🇷🏆@fernandoquadra
@GaryMarcus Sorry @GaryMarcus but what exactly is a "world model"? He talks about it as if it already exists... is there actually a "world model" present here?
English
