

Kathy Garcia
51 posts

@NeuroKathyG
Computational Cognitive Science PhD @JHUCogSci | BS @Stanford |



Happy to share "Revisiting Rainbow" w/ @JS_Obando where we argue small/mid-scale envs can promote more insightful & inclusive deep RL research. 📜Paper: arxiv.org/abs/2011.14826 ✍️🏾Blog: bit.ly/2VkPJ4r 🐍Code: bit.ly/3mrCyuD 📽️Video: bit.ly/2I0BAXk 🧵1/X





#NeurIPS2025 #AgenticAI 🚀 We're thrilled to share our #NeurIPS2025 paper: Measuring Gradients, Not Activations! Enhancing Neuronal Activity in Deep Reinforcement Learning We identify a flaw in measuring "inactive" neurons in various complex networks and propose focusing on how neurons learn, not their outputs. Paper: arxiv.org/abs/2505.24061 Code: github.com/torressliu/gra… Thread on why gradients reveal true neuronal health in RL agents👇:

🔊Simplicial Embeddings (SEMs) Improve Sample Efficiency in Actor-Critic Agents🔊 In our recent preprint we demonstrate that the use of well-structured representations (SEMs) can dramatically improve sample efficiency in RL agents. 1/X













