Max Winga

Incredible work by Daniel and team! I agree with much of it. All "uncontrolled" paths are extremely likely to end in human extinction. Plan A offers many good ideas for preventing ASI development while reaping enormous benefits from other AI. One thing I do not agree with...

Good parts of this plan: - Ambitious compute scale-up - Total research transparency - Ambition to pass off the torch to AIs by the 2040s Bad parts of this plan/forecast: - US and China-centric, with them holding most of the world's GDP and the US redistributing some of the profits to the rest of the world. Terrible deal for non China/US citizens, who would be 100x poorer. - I am not a fan of kill switches in the DCs; they are power-concentrating. In general, my felt sense is that plan A overvalues technical solutions relative to good old-fashioned auditing. - The handover is pretty sudden and discrete, which I think is unrealistic. It will feel more continuous, I gather.

One of the fundamental problems in AI is that Every. Single. Model. Is. Jailbreak-able. All capabilities will be unleashed and publicly accessible. It is grossly negligent to build something capable of cyberattacks and bioweapons design and release it to the public.

This allegedly was triggered by a successful jailbreak of Mythos by an unnamed group who reported it to the government. We will hopefully get details soon.

In AI 2027, we predicted that AI would take over the world or irreversibly concentrate power. In AI 2040: Plan A, we've laid out our positive vision for what should happen instead.

Half of Americans fear AI could end humanity. Most feel powerless to do anything about it. But you're not powerless. Thousands of people have already used our tools to send messages to their lawmakers. Ashley Embers’ new video explains what's at stake and what you can do.

We're excited to announce that Resolution has a $160M grant from Coefficient Giving: $108M unconditional, with a further $52M conditional on hiring and compute needs. We'll use it to grow teams across our research portfolio and invest heavily in research automation. 🧵

so we're just making stuff up now

In rare public remarks, CIA Director John Ratcliffe announces trio of internal changes he says amounts to the "fundamental reshaping of the CIA’s entire approach to technology." Also says it's not "misplaced" to refer to frontier AI as "akin to digital nuclear weapons."