
Fighting the fundamental need to start SF debate club
🚀 Rocket
1.3K posts

@rocketalignment
Yearnalist covering the frontiers of AI @TheInformation. Signal: (530) 400-4184

Fighting the fundamental need to start SF debate club



The results are in. Just 69.5% (n=115) people at this neurips knew what AGI stands for. This is only slightly up from last year. See you again next year!

In AI 2027, we predicted that AI would take over the world or irreversibly concentrate power. In AI 2040: Plan A, we've laid out our positive vision for what should happen instead.

We don’t know whether this will happen, but it’s been surprising that discussions of open-weight AI broadly, and Chinese open-weight in particular, operate in an alternate reality where government security concerns don’t exist, or somehow only apply to closed-weight models.

The AI superintelligence threat to humanity is very real. MIT Professor and Chair of the Future of Life Institute @tegmark: “The top CEOs — Elon Musk, Sam Altman, Demis Hassabis — they all signed this statement about three years ago saying that AI could cause human extinction…” “The same people… didn't actually provide any plan for how they're going to keep humans in charge of this tech.”


AI only has pre-schooler level capabilities for visual tasks. "The frontier models—the best of them—still reason around the age of a preschooler, and any elementary school kid in that benchmark was able to beat all the frontier models on these visual tasks." "These are tasks that are not just object recognition. It's about spatial reasoning... tasks like navigating through the maze…” — @AndrewDai, CEO of Elorian

Tesla has introduced a strict $200 weekly limit on internal AI token spending for engineers. @gracekaynews explains the industry-wide crackdown on tokenmaxxing: "Software engineers in particular were spending upwards of several thousand dollars a week on AI tokens, so definitely cutting back."