Peter McIntyre

I spent 7 years preparing to be a doctor before finally realising how much more I could help outside the hospital. So, I put together a team and built a course to help people avoid making the same mistake: non-trivial.org/courses/how-to… Some stuff I really wish I’d known... (1/20)

Opus 4.5 automated 3.75% of the tasks on the Remote Labor Index (eval composed of many diverse freelancer tasks). Performance is doubling every ~4 months so far! Could see this getting to somewhere between 8%-30% by December, which would be a big deal for the economy.

We’re hiring someone to run the Anthropic Fellows Program! Our research collaborations have led to some of our best safety research and hires. We’re looking for an exceptional ops generalist, TPM, or research/eng manager to help us significantly scale and improve our collabs 🧵

The world needs more founders building a safe and aligned AI future. We’ve added a 5050 AI track to help researchers start companies civilization needs. You’ll learn from mentors including Wojciech Zaremba (OpenAI co-founder), Ross Girshick (Vercept co-founder), Emmett Shear (Softmax co-founder), Dileep George (Vicarious co-founder), and Ronnie Chatterji (Chief Economist at OpenAI). As AI capabilities accelerate, safety struggles to keep up. Startups can help make safety the default at scale. If you’re working on safety evaluation and red-teaming, interpretability, alignment infrastructure, governance and compliance, human-AI collaboration, robustness tools, biosecurity, AI-powered cybersecurity, or something outside this list to build an aligned future -- or you want to be -- reach out. 5050, our founder foundry, is a free program to help great scientists, researchers, and engineers become great founders. We’ve helped launch 78 companies, many of which wouldn’t exist otherwise. 5050 will teach you everything you need to start a deep tech startup. You’ll also join a community of entrepreneurial scientists and engineers to navigate the founder journey together. 5050 alumni, many of whom are now founders, are eager to share their experiences and support your journey. Whether you’re validating an idea or ready to build, 5050 is for you. Applications for our US and UK cohorts are open!

Can we get AI to stabilize the world faster than it disrupts it? Even as AI poses risks, it’ll provide new tools for navigating those risks. But these tools won't develop themselves (yet!). In a new 📄, we explore what tools would help most & how to outpace broad AI progress.

Is AGI an “all or nothing” problem? Failure on alignment = AI takeover, and success = AI solves everything? In a new paper with @finmoorhouse we argue no. We describe the dizzying range of challenges AGI will pose, *even if* we succeed at alignment. forethought.org/research/prepa…

@EthanAlley listennotes.com

any recs for a podcast search engine? my dream: search a person, get a feed of exactly all episodes they appear in across any pod.

I'm proud of GoogleDeepMind/Google's v2 update to our Frontier Safety Framework. We were the first major tech company to produce an explicit risk management framework for extreme risks, and I'm glad we are continuing to push ahead on safety best practice. deepmind.google/discover/blog/…

Super exciting robustness result: We built a system that defends against universal jailbreaks! It has minimal increase in refusal rate and moderate inference cost.

Non-Trivial is an online fellowship for high schoolers to start an impactful research or policy project. You'll join a world-class community and learn from speakers like AI pioneer Yoshua Bengio and philosopher Peter Singer. 📅 Early applications close 𝐌𝐚𝐫𝐜𝐡 𝟑𝟏𝐬𝐭!

We published a piece in Scientific American today on how accurate (or inaccurate) different personality tests are! Here's a lovely chart that they made for the article based on our study results (attached). Link to the article is below:

"we investigated... team performance distributions by relying on 274 performance distributions including 200,825 teams (e.g., sports, politics, fire-fighters, information technology, customer service)" "only 11% of the distributions were normal" pubsonline.informs.org/doi/10.1287/or…

@stephenclare_ @PauseAI Also tagging folks who might have takes @ilex_ulmus @labenz @liron @gmiller

@stephenclare_ The @PauseAI folks have some valid concerns about the risks from advanced AI. That doesn't mean their approach will be effective. This article makes the imo convincing point that there are more feasible approaches that achieve the same thing as a pause: forum.effectivealtruism.org/posts/avrFeH6L…

As a teenager, Isaac Newton invented calculus. Mary Shelley wrote Frankenstein at age 18. Many people miss out on opportunities during their youth because they lack confidence or knowledge. What is the best advice you would give your 16-year-old self today?

Could a war get large enough to cause an existential catastrophe: human extinction or a global civilisational collapse? It seems *very* unlikely, but we can't rule out the possibility. To be more specific: I think the chance of such an event this century is between 0.05% and 2%

@NathanpmYoung Type 3 audio (@peterhartree and co) recommends Verbalize blog.type3.audio/how-to-generat…

What's the best speech to text app. I hear whisper is good but I don't know how to use it.

Non-Trivial is a course for pre university students to work on improving the world. Peter is someone I'd trust and I wish I'd done this course as a teen. Good thread too.

[6] backend.orbit.dtu.dk/ws/portalfiles… Another indicator of rising productivity: the average American’s salary peaks at age 51-60. econometricsociety.org/sites/default/…

[5] reducing-suffering.org/why-charities-…

Do you have an idea you think could change the 🌍? Here’s a big mistake people often make, and 3 tips to avoid it.