
Shiyi Zoe Du
45 posts

Shiyi Zoe Du
@zzzoooeee321
PhD Researcher at @SCSatCMU working on Agentic RL / AI4Science | Ex intern/ra at Shanghai AI Lab, West China Hospital, Johns Hopkins U


// The Memory Curse in LLM Agents // (bookmark it) Long histories apparently degrades agents as they become increasingly history-following and risk-minimizing. Across 7 LLMs and 4 social dilemma games over 500 rounds, expanding accessible history degraded cooperation in 18 of 28 model–game combinations. They call it the memory curse. Lexical analysis of 378,000 reasoning traces shows the mechanism: it's not that agents become paranoid, it's that forward-looking intent erodes. Long histories pull the model into reasoning about past slights instead of future payoffs. A LoRA adapter trained only on forward-looking traces mitigates the decay and transfers zero-shot to new games. Memory sanitization, keeping prompt length fixed but swapping in synthetic cooperative records, restores cooperation, proving the trigger is content, not length. And ablating explicit Chain-of-Thought often reduces the collapse, meaning deliberation actively amplifies the curse. Paper: arxiv.org/abs/2605.08060 Learn to build effective AI agents in our academy: academy.dair.ai




People talk, listen, watch, think, and collaborate at the same time, in real time. We've designed an AI that works with people the same way. We share our approach, early results, and a quick look at our model in action. thinkingmachines.ai/blog/interacti…

My friend at Google is urgently looking for Student Researchers for Research projects related to coding agents during summer. Part-time is possible. If you’re interested and have relevant experience, feel free to DM me!


📰 RL for LMs often relies on imperfect proxy rewards, which can lead to reward hacking. But are incorrect rewards necessarily harmful? Turns out, they can also be benign or even beneficial! This has implications for reward model evaluation and verifiable reward design. 🧵









