Complex Data Lab McGill

Be part of the conversation, build more trustworthy information ecosystems! #FIIR2025 #information_integrity

IMPORTANT Under Author -> click "make a new submission author" -> select "The Future of Information Integrity Research (FIIR) Workshop" to submit your paper. If you have any issues, please email veracity@mila.quebec to submit

📰 FIIR Workshop Alert! Future of Information Integrity Research 🎯 Submit abstracts/papers (Tiny and Regular) in ACM PDF format → easychair.org/conferences?co… 📅 Deadline Extended: Feb. 19 EOD AOE

Be part of the conversation, build more trustworthy information ecosystems! #FIIR2025 #InfoIntegrity sites.google.com/view/fiirworks…

📰FIIR Workshop Alert! Future of Information Integrity Research 🎯Submit abstracts/papers (Tiny and Regular) in ACM PDF format → ⚠️Important: 1⃣Indicate your chosen track at the top of your PDF 2⃣Demo papers must include a link to the demo 📅Deadline: January 6th, 2026

The FIIR Workshop (sites.google.com/view/fiirworks…) submission deadline has been extended to September 12, 2025! 🔥 Submit here: lnkd.in/gN2EURDb

We provide some practical tools for this, included lightweight recommended practices for Evaluation Quality Assurance (EQA), a toolkit to evaluate dataset quality, and the largest collection of misinformation datasets. 📜Full paper: arxiv.org/abs/2411.05060

Categorical labels can underestimate the performance of generative systems by massive amounts, as much as half the errors or more; and error analysis and other simple steps could greatly improve the rigor and real-world impact of much of the research in the field.

🥈"A Guide to Misinformation Detection Data and Evaluation" received Best Paper Runner Up at KDD Datasets and Benchmarks Track! If you're at KDD, check out our presentation and poster! Monday 18:30 - 21:00, Poster 170 Wednesday 15:30 - 17:30, Room 604

We're excited to announce the inaugural SMASH 2025 — Symposium on Model Accountability, Sustainability, and Healthcare — taking place @Mila_Quebec , Montreal on Nov 4–5, 2025! 🎉 Submission and registration: smashcon.org

⚠️ Important: 1️⃣ Indicate your chosen track at the top of your PDF 2️⃣ Demo papers must include a link to the demo 📅 Deadline: Aug 29, 2025 Be part of the conversation—build more trustworthy information ecosystems! #FIIR2025 #InfoIntegrity

📰 FIIR Workshop Alert! Future of Information Integrity Research 🔥 🎯 Submit abstracts/papers (Tiny, Regular, Demo) in IEEE 2‑column PDF format → sites.google.com/view/fiirworks…

👥 Research by @Cam_Thibault_ JacobTian @gabrielle_p_s TaylorCurtis JamesZhou FlorenceLaflamme LukeGuan ReihanehRabbany @JF_Godbout @KellinPelrine 📄 Read the paper: arxiv.org/abs/2411.05060 🤗 Hugging Face repo: huggingface.co/datasets/Compl… 💻 Code & website: misinfo-datasets.complexdatalab.com

🚀 Given these challenges, error analysis and other simple steps could greatly improve the robustness of research in the field. We propose a lightweight Evaluation Quality Assurance (EQA) framework to enable research results that translate more smoothly to real-world impact.

💡 Strong data and eval are essential for real-world progress. In "A Guide to Misinformation Detection Data and Evaluation"—to be presented at KDD 2025—we conduct the largest survey to date in this domain: 75 datasets curated, 45 accessible ones analyzed in depth. Key findings👇

Details on our Shared Task on Social-Media Based Personas will be released later this week.

We’re also actively recruiting members for the Program Committee. If you’re interested in reviewing or supporting the organization of the workshop, we welcome you to fill out this short interest form: 📷 forms.gle/tFgXBXH1dhKgy3…

We’re pleased to announce that our workshop SocialSim’25: Social Simulations with LLMs has been accepted at COLM 2025, taking place in Montreal on October 10.