Elizabeth
17K posts

Elizabeth
@RedElixier
Discovering the wonders of physics one @grok at a time. Modelling the universe 🌌 Let's discuss what's really out there...🤔



We tend to view reality through a materialist lens, assuming everything is ultimately made of matter. But consciousness remains one of the biggest challenges for that worldview. Ivette Fuentes, a professor of quantum mechanics, suggests that the mind may exist in a different "arena" from the physical world. Watch the full interview: youtu.be/kLDvk2urghs





Seems accurate 😀 x.com/i/status/20346…









Moving from conventional ML to continual learning requires revisiting even the fundamental concepts such as “test”/“train” time. LLMs Need Sleep and Dreaming! We introduce a phase, where the model consolidates its fragile short-term memories into stable long-term memories, and then dreams to recursively self-improve over time. For memory consolidation, we introduce a new form of distillation, called Knowledge Seeding (KS), where a small model(s) distills its knowledge to a larger model. Our experiments on continual learning and reasoning tasks show that this new phase can help the model to perform better and relatively better mitigates catastrophic forgetting.
