
AIs can sometimes detect control interventions, but detection is mostly near chance. Awareness depends on the agent, monitor, and environment triple. We built CIAware-Bench to measure control intervention awareness. 🧵
Roland S. Zimmermann
119 posts

@zimmerrol
Research Scientist @GoogleDeepMind // Machine Learning (formerly Physics) // Previously @bethgelab @MPI_IS @uni_tue @GoogleAI

AIs can sometimes detect control interventions, but detection is mostly near chance. Awareness depends on the agent, monitor, and environment triple. We built CIAware-Bench to measure control intervention awareness. 🧵

AIs can sometimes detect control interventions, but detection is mostly near chance. Awareness depends on the agent, monitor, and environment triple. We built CIAware-Bench to measure control intervention awareness. 🧵





CoT monitoring is one of our best shots at AI safety. But it's fragile and could be lost due to RL or architecture changes. Would we even notice if it starts slipping away? 🧵

CoT monitoring is one of our best shots at AI safety. But it's fragile and could be lost due to RL or architecture changes. Would we even notice if it starts slipping away? 🧵

As we build increasingly powerful AI models, we’re committed to responsible development. We’re implementing our latest Frontier Safety Framework – our most comprehensive approach yet for identifying and staying ahead of emerging risks. Find out more → goo.gle/3W1ueFb

MATS 9.0 applications are open! Launch your career in AI alignment, governance, and security with our 12-week research program. MATS provides field-leading research mentorship, funding, Berkeley & London offices, housing, and talks/workshops with AI experts.

We just shipped Gemini 2.5 Deep Think it doesn't just recall research papers - it fuses ideas across papers in ways I haven't seen before this level of capability demands careful evaluation model card below 👇



Can frontier models hide secret information and reasoning in their outputs? We find early signs of steganographic capabilities in current frontier models, including Claude, GPT, and Gemini. 🧵




