Philip E. Tetlock

2.7K posts

Philip E. Tetlock banner
Philip E. Tetlock

Philip E. Tetlock

@PTetlock

Penn-Integrates-Knowledge (PIK) Professor, Wharton & School of Arts & Sciences. Likes = interesting; Retweets = very interesting; Interesting ≠ endorsement

Philadelphia, PA Katılım Ekim 2011
639 Takip Edilen47.8K Takipçiler
Philip E. Tetlock retweetledi
Forecasting Research Institute
We completed the most comprehensive study of how economists and AI experts think AI will affect the U.S. economy. They predict major AI progress—but no dramatic break from economic trends: GDP growth rates similar to today's and a moderate decline in labor force participation. However, when asked to consider what would happen in a world with extremely rapid progress in AI capabilities by 2030, they predict significant economic impacts by 2050: • Annualized GDP growth of 3.5% (compared to 2.4% in 2025) • A labor force participation rate of 55% (roughly 10 million fewer jobs) • 80% of wealth held by the top 10% (highest since 1939) 🧵 Here's what we found:
Forecasting Research Institute tweet mediaForecasting Research Institute tweet media
English
11
104
314
146.9K
Philip E. Tetlock retweetledi
Philip E. Tetlock
Philip E. Tetlock@PTetlock·
Variants of this question are popping up a lot nowadays: How much should the moral character of an artist or scholar or scientist sway our assessments of the value of their creative output?
Rob Henderson@robkhenderson

While Marx's wife was pregnant, he impregnated their housemaid. To hide this from Marx's wife so she wouldn't get angry, Engels pretended he was the father. Then they gave the kid away. Both Marx and Engels abandoned him, pretending the kid didn't exist. nytimes.com/1983/03/14/opi…

English
13
4
43
10K
Philip E. Tetlock
Philip E. Tetlock@PTetlock·
My collaborators in @Research_FRI have released latest AI progress forecasts from LEAP (Longitudinal Expert AI Panel). Experts continue to underestimate benchmark progress but also expect big increases in tech company valuations & data center buildout. For details: forecastingresearch.substack.com/p/what-experts…
Forecasting Research Institute@Research_FRI

What do experts and superforecasters think about the future of AI research and development? In Wave 4 of the Longitudinal Expert AI Panel (LEAP), we asked top AI experts to forecast progress in AI R&D, hiring, company valuations, data center buildout, and more. Here’s what you need to know 🧵

English
1
7
23
4.8K
Philip E. Tetlock retweetledi
Igor Grossmann, PhD @igi.bsky.social
Can we predict the past? 🔮 New open-access paper in American Historical Review proposes 'Retrodiction'—using gaps in the archival record to test historical theories. Interdisciplinary collab feat. David Gill, Marc Trachtenberg, @PTetlock @cendripetalfrce, and more 🧵👇
English
2
9
28
4.5K
Philip E. Tetlock
Philip E. Tetlock@PTetlock·
@Research_FRI is dedicated to improving signal-to-noise ratios in heated debates. LEAP, Longitudinal Expert AI Panel, elicits testable forecasts of AI progress each month. First-wave results will frustrate extremists at both ends of opinion spectrum but if you love nuance...
Forecasting Research Institute@Research_FRI

In Bloomberg today, FRI Chief Scientist, @PTetlock argues that the debate over AI progress needs falsifiable forecasts rather than broad statements: "The debate over the future of AI deserves fewer overconfident proclamations and more precise, policy-relevant predictions. Careful forecasting surveys, of the kind I’ve spent my career working on, can test arguments against reality and, in time, affirm the voices that consistently deliver reliable, actionable guidance."

English
1
8
24
7K
Philip E. Tetlock retweetledi
Forecasting Research Institute
Forecasting Research Institute@Research_FRI·
Today, we are launching the most rigorous ongoing source of expert forecasts on the future of AI: the Longitudinal Expert AI Panel (LEAP). We’ve assembled a panel of 339 top experts across computer science, AI industry, economics, and AI policy. Roughly every month—for the next three years—they’ll provide precise, falsifiable forecasts on the trajectory of AI capabilities, adoption, and impact. Our results cover where experts predict major effects of AI, where they expect less progress than AI industry leaders, and where they disagree. LEAP experts forecast major effects of AI by 2030, including: ⚡ 7x increase in AI’s share of U.S. electricity use (1% -> 7%) 🖥️ 9x increase in AI-assisted work hours (2% -> 18%) By 2040, experts predict: 👥30% of adults will use AI for companionship daily 🏆60% chance that AI will solve or substantially assist in solving a Millennium Prize Problem 🚂32% chance that AI will have been at least as impactful as a "technology of the millennium," like the printing press or the Industrial Revolution. 🧵Read on for more insights and results
Forecasting Research Institute tweet mediaForecasting Research Institute tweet media
English
17
85
256
83.1K
Philip E. Tetlock
Philip E. Tetlock@PTetlock·
When I first read “When Prophecy Fails” in grad school—eons ago—I wondered whether this case study was “too neat/ theoretically convenient to be true.” Prof warned “don’t let anyone else hear you say that. Festinger is sacrosanct.” Another reason for my fascination with taboo topics.
Robin Hanson@robinhanson

"When Prophecy Fails … the case was misrepresented. The cult did not persist, proselytize, or reinterpret its failure as a spiritual triumph. Its leader recanted, the group disbanded, and belief dissolved."

English
12
46
421
64.7K
Philip E. Tetlock
Philip E. Tetlock@PTetlock·
Tim Minto was a super-superforecaster in the old IARPA tournaments. And the dictionary is on his side. But I bet, deep down, Tim agrees "uniqueness" is a matter of degree – a function of how hard it is to find relevant comparison classes & base rates. I'm also betting the uniqueness of forecasting questions is a key moderator of size of current performance gaps between top human forecasters and AIs
Tim Minto@tim_minto

How can you be "one of the most singular" of anything?

English
2
0
12
5.5K
Philip E. Tetlock
Philip E. Tetlock@PTetlock·
Latest from my colleagues at Forecasting Research Institute (FRI): Superforecasters still outperform top LLMs. But for how much longer? Linear extrapolation from recent ForecastBench data suggests LLMs will surpass top humans in November 2026. And linear extrapolation is itself a tough benchmark for both humans & LLMs to beat
Forecasting Research Institute@Research_FRI

🔮 When will AI forecasters match top human forecasters at predicting the future? In a recent @cowenconvos podcast episode, @NateSilver538 said 10–15 years while @tylercowen predicted 1–2 years. Who was right? Our updated AI forecasting benchmark, ForecastBench, suggests that Tyler Cowen is more likely to be right.

English
2
18
72
19.3K
Philip E. Tetlock retweetledi
Forecasting Research Institute
Forecasting Research Institute@Research_FRI·
🔮 When will AI forecasters match top human forecasters at predicting the future? In a recent @cowenconvos podcast episode, @NateSilver538 said 10–15 years while @tylercowen predicted 1–2 years. Who was right? Our updated AI forecasting benchmark, ForecastBench, suggests that Tyler Cowen is more likely to be right.
Forecasting Research Institute@Research_FRI

Is AI on track to match top human forecasters at predicting the future? Today, FRI is releasing an update to ForecastBench—our benchmark that tracks how accurate LLMs are at forecasting real-world events. A trend extrapolation of our results suggests LLMs will reach superforecaster-level forecasting performance around a year from now. Here’s what you need to know: 🧵

English
5
15
50
33.6K