Aviya Maimon

Aviv, a research scientist with Google Earth AI, walked us through how his work provides first responders, crisis planners, and others with the information they need to save lives. Interested in similar roles? Explore our open AI/ML jobs ➡️ goo.gle/4iyaDXQ

We release: ✅ Code ✅ Leaderboard ✅ Skill matrices & tools Let’s shift to skill‑based evaluation for LLMs! Full paper here 👉 arxiv.org/abs/2507.20208 (6/6)

Why this matters: 🔍 Interpretable evaluations ⚡ Smarter model selection 🧪 Better benchmark design It's time to move past single-score leaderboards and embrace nuanced, skill-based evaluation (5/6)

🚨 New paper alert! 🚨 We propose an IQ Test for LLMs — a new way to evaluate models that goes beyond benchmarks and uncovers their core skills. Think: 🧠🤖 psychometrics for LLMs. 👇 (1/6)

RefVNLI Towards Scalable Evaluation of Subject-driven Text-to-image Generation

🚀 Big news for #VisualRiddles! We’re excited to announce that Visual Riddles has been accepted to the Creative AI Track at NeurIPS 2024! 🎉 Come explore our Visual Riddles Gallery—a showcase of cognitive and visual challenges for multimodal AI. 🧵