MATS Research

154 posts

MATS Research banner
MATS Research

MATS Research

@MATSprogram

MATS empowers researchers to advance AI alignment, transparency, and security

Berkeley, CA Katılım Kasım 2023
136 Takip Edilen4.2K Takipçiler
MATS Research retweetledi
Jacob Pfau
Jacob Pfau@jacob_pfau·
Can you train honest AI via self-play debate? Research update from @Joanvelja, Lennie Wells from MATS, @ihsgnef, and me. RL on debate games does boost answer accuracy on MATH, but debaters quickly learn to hack the judge 🧵 lesswrong.com/posts/6mLwAuFA…
Jacob Pfau tweet media
English
3
12
61
11.5K
MATS Research
MATS Research@MATSprogram·
The MATS Career Fair is July 29 in Berkeley. If your org is hiring in alignment, interpretability, security, or governance — come meet the people doing the work! 100+ fellows. 80% go on to work directly in AI safety. RSVP here: matsprogram.org/cf-s26
English
1
1
80
5.3K
MATS Research retweetledi
Ryan Kidd
Ryan Kidd@ryan_kidd44·
Expressions of interest to mentor for MATS Winter 2027 Program close soon! If you work in the fields of AI alignment, governance, interp, or security and want to mentor with MATS, please let us know by Jul 10! matsprogram.org/mentor-eoi
English
1
3
26
2K
MATS Research
MATS Research@MATSprogram·
Join MATS in Seoul for our evening social mixer at ICML on Day 2 of the main conference! Meet and talk to research managers, MATS alumni, and conference attendees about the most important questions in AI alignment and security. RSVP here: luma.com/8f6i91q9
English
0
2
65
4.6K
MATS Research
MATS Research@MATSprogram·
🧬 Michael Yu's VFUSE A mechanistic interpretability approach surfacing the protein-design features that activate only on hazardous structures.
English
1
1
15
1.1K
MATS Research
MATS Research@MATSprogram·
What happens when you stop trying to make AI models do what you want, and start paying attention to what they actually are?Our latest post explores creativity, imagination, and beauty in AI safety through the work of our fellows 🧵
English
2
5
122
11.4K
MATS Research
MATS Research@MATSprogram·
🚨 Applications for MATS Autumn 2026 close tonight (June 7 AoE)! Spend 10 weeks fully funded working with mentors from Anthropic, DeepMind, OpenAI, Redwood Research, SecureBio, and more. New this cohort: 🧬 Biosecurity 🚀 Founding & Field-Building Apply now: matsprogram.org/apply
MATS Research tweet media
English
6
11
156
60.1K
MATS Research retweetledi
Akshat Naik
Akshat Naik@aksh_n0·
Trained monitors can be strong low-cost alternatives to prompted frontier models for black-box scheming detection. Our fine-tuned open-weight monitors detect scheming/sabotage in agent trajectories better than small prompted models and are on the cost-performance frontier. (1/n)
Akshat Naik tweet media
English
1
7
29
6.9K
MATS Research retweetledi
Celeste (ICML!)
Celeste (ICML!)@celestepoasts·
New research from @japhba and I! Activation Oracles are a pretty cool interpretability tool. They answer natural questions about activations, but they suffer from vagueness and hallucinations. Can AO training be improved? Turns out: Yes! We identify four fixes that make AOs substantially more useful!
Celeste (ICML!) tweet media
English
12
25
227
32.4K
MATS Research retweetledi
Cas (Stephen Casper)
Cas (Stephen Casper)@StephenLCasper·
Apply by June 7 to work with MATS in the Fall. In the MATS stream that I coordinate, we will work on impact-oriented technical AI governance research, potentially including research on open-weight models, AI safeguards, AI incidents, technically rigorous AI policy, etc.
MATS Research@MATSprogram

1/ 🚨 MATS Autumn 2026 applications are now open. 10-week fully-funded fellowship for aspiring AI alignment, security & governance researchers and field-builders. 📍 Berkeley + London 📅 Sep 28 – Dec 4, 2026 💰 $5000/month stipend + $8,000/month compute Apply by June 7 AoE ↓

English
1
7
117
9.1K
MATS Research retweetledi
Nick Raushenbush
Nick Raushenbush@nickraushenbush·
Excited to serve as a mentor on the @MATSprogram founding & field-building track this autumn. If you're interested in moving into AI security and alignment, critical cyber security, or biosecurity, you should consider applying. Deadline is June 7th.
MATS Research@MATSprogram

🚨 New for MATS Autumn 2026: the Founding & Field-Building track. A fully-funded track for founders, field-builders and amplifiers ready to launch and scale new AI safety initiatives. Apply by June 7 AoE ↓

English
0
1
1
834
MATS Research retweetledi
Nora Ammann
Nora Ammann@AmmannNora·
Apply by June 7th to work with me on the institutional stack for the post-AGI world: moral reasoning, bargaining, structured transparency, trust infrastructure, and resilience capabilities.
MATS Research@MATSprogram

🚨 New for MATS Autumn 2026: the Founding & Field-Building track. A fully-funded track for founders, field-builders and amplifiers ready to launch and scale new AI safety initiatives. Apply by June 7 AoE ↓

English
0
10
115
11.7K
MATS Research retweetledi
Max Nadeau
Max Nadeau@MaxNadeau_·
This track—and MATS more broadly—is a great way to develop an idea for a new AI safety org to the point where it's ready for CG funding. I bet we'll end up making some seven- or eight-figure grants to new orgs that come out of MATS this year.
MATS Research@MATSprogram

🚨 New for MATS Autumn 2026: the Founding & Field-Building track. A fully-funded track for founders, field-builders and amplifiers ready to launch and scale new AI safety initiatives. Apply by June 7 AoE ↓

English
0
4
101
7.8K
MATS Research retweetledi
Charlie Petty
Charlie Petty@incredutility·
Geoff Ralston @gralston and I are teaming up to mentor a biosecurity stream for @MATSprogram this fall. Check out the other great streams!
MATS Research@MATSprogram

Streams led by: · @dewierwan_ (BlueDot) · @MikeMcCormick_ & @nickraushenbush (@HalcyonFutures ) · @gralston & @incredutility (Bio Action Plan) · @LisaThiergart & @luiscosio (@SL5TaskForce) · @AmmannNora (ARIA) · @RosieCampbell (@eleosai ) · @degerturann (@metaculus)

English
0
3
11
1.6K
MATS Research retweetledi