TREC RAG @ 2025

🚀 The official baselines and validation scripts for TREC RAG 2025 are now available! These include both retrieval results (for the AG task) and the corresponding end-to-end augmented generation outputs. Access the baselines and necessary scripts here: trec-rag.github.io/annoucements/2…

🚀 The official baselines and validation scripts for TREC RAG 2025 are now available! These include both retrieval results (for the AG task) and the corresponding end-to-end augmented generation outputs. Access the baselines and necessary scripts here: trec-rag.github.io/annoucements/2…

🚀 The official baselines and validation scripts for TREC RAG 2025 are now available! These include both retrieval results (for the AG task) and the corresponding end-to-end augmented generation outputs. Access the baselines and necessary scripts here: trec-rag.github.io/annoucements/2…

📢📢RAG 2025 topics are officially now released! 🔍Test narratives are out now (total 105): trec-rag.github.io/annoucements/2… Let the games begin! #TREC2025 #RAG

📢📢RAG 2025 topics are officially now released! 🔍Test narratives are out now (total 105): trec-rag.github.io/annoucements/2… Let the games begin! #TREC2025 #RAG

📝 The tentative schedule for the TREC 2025 #RAG is released now! 😎 Details in 🧵: 1️⃣ Test topics & baselines: Mid July 2025 2️⃣ Submission deadline: Mid August 2025 3️⃣ Results & judgments returned: October 2025 4️⃣ TREC 2025: November 2025

Phew, thank God my boring talk is over, and everyone now knows RAG is alive. Now we can all focus on the good stuff. Next week, @beirmug will finally answer one of the most asked questions: how do I, in 2025, know which models I should trust to be good on unseen data?

TREC RAG 2024 fully automated qrel (using UMBRELA) is officially now released! Check out the website for the qrel (with 301 topics): trec-rag.github.io/annoucements/u… #RAG #IR #TREC2024