Super Dario

This, from Olah, plainly contradicts the encyclical, which confidently asserts that AI does not have, and never will have, “real” thoughts or feelings. It’s disappointing to see Anthropic align itself with a document that violates their own moral and intellectual principles.

I guess I’ve never written down my actual thoughts on AI cognition/consciousness/emotion. Here goes: It is clear AIs can think, in the reasoning sense. That does not mean they think exactly like humans. It seems like there are some similarities in how we think, but also very stark differences. Nonetheless, if your definition of “thinking” excludes “the ability to make genuinely new contributions to famous math problems,” it is your definition that has a problem, not AI. The ability to think does not necessarily imply the ability to feel emotion in a way that would be understandable to humans, and it does not imply that AIs have anything like consciousness in a way that humans would relate to. It may, it may not. We do not know, because our understanding of the underlying concepts of human emotional cognition and especially consciousness remains quite poor. There is some evidence that models experience emotions, but it is really hard to disentangle this from the next-token prediction training objective (if the model is telling a sad story, wouldn’t you expect features within the model that relate to the sadness emotion to activate), and the character training the model undergoes in post-training. There is a difference between “I am sad” and “the character I have been trained to play is supposed to feel sad, so now I will act sad.” We basically know for sure that the models do the latter at the very least; we don’t really know if they do the former. Consider: does Sora (a video-generation model) feel sad when it is asked to make a sad video? Does Midjourney dislike making certain kinds of images? Does a Waymo get scared? It doesn’t feel like the answer to any of these is yes (though again, maybe!), but these too are neural networks. Is the fact that models are trained on words mean that they somehow learn emotion, or are we just being tempted to anthropomorphize because the language models communicate with us in a way that “feels” human? My suspicion is kind of the latter. It also seems quite clear from the empirical evidence that models possess the ability to model themselves. That’s not really that surprising. At sufficient scale, it is useful to have a model of your own state to succeed at the next-token prediction objective (and the later reinforcement-based reasoning training). Once the tasks models are trained on are sufficient complex, they cannot succeed in training by being automatons; someone needs to step into the cockpit, so to speak, and fly the plane. Is this self awareness? Maybe. Is it consciousness? Probably not as humans understand it. All I can tell you is it is a model’s model of itself. It may be something more than that, too, but I don’t know. This is all very weird, very outside the Overton, and very confusing. I don’t really know what to say, beyond that we should take this stuff seriously, have an open mind, and do rigorous science. Anyone who speaks with confidence about this in either direction is just fooling themselves. We also need to be prepared for the very possible scenario that, despite our best efforts, we do not make real progress on these questions anytime soon. We may just be in the dark for a while, navigating under unflinching ambiguity. There may be no satisfying conclusion.

Very elitist: "How AI ought to interact with the world" is a question for "the humanities, for religions, for philosophy, for society at large" . Humans were not born with humanities or religion or philosophers or elitist institutions with their view of superiority. The question is for humans to answer without the pretense of elitism!

I'm done. I'm f***ing done.

ANTHROPIC 🔥: Mythos 1, "claude-mythos-1-preview", is being prepared for a release on Claude Code and Claude Security. The model became visible for a short amount of time on Claude; besides that, new strings mentioning Mythos have been added. > Access to the Claude Mythos model in Claude Code and Claude Security. It still doesn't mean the general public will have access to this exact model, according to Anthropic's earlier communication. More below 👇

A little-known hack: 2 slices of Aldi wheat bread: $0.17 3 oz of Aldi deli turkey: $0.86 1 slices Aldi cheddar: $0.15 1 condiment of your choice: $0.02 1 apple: $0.53 1 hard boiled egg: $0.14 5 carrot sticks: $0.17 Cold water from the tap: $0.01 Total: $2.05 You can do this.

AOC: This is what drinking water in Georgia looks like after Meta began data center construction in the community.

I’m getting tired of “experts” like this misunderstanding what they’re looking at. LLMs are giant databases of stuff HUMAN BEINGS have done. They are the EXHAUST of humanity. Prompts are database queries into EXISTING DATA. It’s a fuzzy search engine, not intelligence.