MSMarco 리트윗함
English
MSMarco
294 posts
MSMarco 리트윗함
If you are at #TREC2023 this morning, then come down to room 3-CD for the TREC Deep Learning Track workshop and don't forget to pick up a TREC Deep Learning Track 5 year celebration sticker!
English
Fifth and final year of the #TREC Deep Learning Track. What an amazing journey this has been, thank you one and all! 🙏 #TREC2023 #TRECDL #TREC2023DL
Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek
On my way to #TREC2023. ✈️ This is the 1st year of the Tip-of-the-Tongue (ToT) Track and the 5th (& final) year of the Deep Learning (DL) Track. Looking forward to seeing many of you in-person for the first time since the pandemic! #TREC #TRECToT #TRECDL #TREC2023TOT #TREC2023DL
English
MSMarco 리트윗함
🔔 Reminder: The deadline for run submissions for the TREC 2023 Deep Learning Track is in 1 WEEK! #TRECDL #TREC2023DL
Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek
⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL Guidelines and more info: microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL
Guidelines and more info: microsoft.github.io/msmarco/TREC-D…
GIF
Nick Craswell@nick_craswell
Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
We are pleased to announce that we have released the test queries for the TREC 2023 Deep Learning Track. This year, we have some 'synthetic' queries to explore whether we can glean insights about system performance using queries generated by LLMs.
#TREC #TREC2023DL
Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek
Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽 Guidelines and more info: microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL
Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽
Guidelines and more info: microsoft.github.io/msmarco/TREC-D…
Nick Craswell@nick_craswell
Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL
@MSMarcoAI microsoft.github.io/msmarco/TREC-D…
English
🔔We are back up again. Sorry ya'll for any inconvenience caused by this.
MSMarco@MSMarcoAI
⚠️There is a small ongoing configuration issue with our Azure storage account because of which the MS MARCO and related datasets are currently not accessible. We are actively working on this and hope to bring it back up soon. Sorry for the inconvenience!
English
MSMarco 리트윗함
The TREC-DL Track will celebrate 5th anniversary this year.🎂 Focus will be on comprehensive passage runs judging and using those for document runs eval. Test queries to be released in June. Submission deadline: July 31st. #TRECDL #TREC2023DL
Guidelines: microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
I'm co-organizing 2 TREC tracks this year: Tip-of-the-Tongue & Deep Learning. Excited that 20+ groups have already registered for each. 🙌🏽#TREC2023 #TREC2023ToT #TREC2023DL #TRECToT #TRECDL
Please Register: ir.nist.gov/trecsubmit.ope…
Also, guidelines for both tracks are now online.
English
Important 🧵
Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek
Thanks for raising this @macavaney! This is a very important conversation relevant to 3 evaluation scenarios that are worth discussing separately: 1. TREC-DL 2023 2. MS MARCO ranking leaderboard 3. Private evaluation for papers using MS MARCO / TREC-DL data A quick thread... 🧵
English
MSMarco 리트윗함
Super excited about #TREC'23!🙌🏽 This year is the 5th anniversary🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track😎 at TREC w/ complex and ambiguous information needs. Please participate!
trec.nist.gov/pubs/call2023.…
TREC Tip-of-the-Tongue Track@TREC_ToT
We're organizing The Tip-of-the-Tongue (ToT) Track at #TREC, a shared task on known-item identification where the searcher cant recall a reliable identifier (It’s on the tip of my tongue…) Follow us for announcements/updates and dont forget to participate in the track! #TRECToT
English
MSMarco 리트윗함
Quick follow-up: Here's our poster summarizing the TREC 2022 Deep Learning track. #TREC2022DL #TREC2022 #TRECDL
English
MSMarco 리트윗함
Was a pleasure to present the 4th Deep Learning Track overview at #TREC2022. We had healthy track participation and observed bigger gaps between trad. and NN based methods, and better distribution of system performances across queries. #TREC2022DL #TRECDL
microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
Slides from my recent invited talk @SpotifyResearch reflecting on benchmark development, community building, and robust scientific progress based on my experience working on @MSMarcoAI and TREC Deep Learning Track.
slideshare.net/BhaskarMitra3/…
Thank you @CharlotteHase for hosting me!
English
MSMarco 리트윗함
TREC 2022 Deep Learning Track test queries (+ top-100 candidates for reranking subtask) has been released.📣 #TREC2022DL #TREC2022
Run submission deadline: *Aug 10*
More info: microsoft.github.io/msmarco/TREC-D…
Please RT.
Nick Craswell@nick_craswell
Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL
@MSMarcoAI microsoft.github.io/msmarco/TREC-D…
English
MSMarco 리트윗함
📣TREC 2022 Deep Learning Track submission guidelines are out: microsoft.github.io/msmarco/TREC-D…
Submission deadline: Aug 10
This will be the second year using the V2 collection. Test queries are coming soon!
#TREC #TREC2022 #TREC2022DL #MSMARCO #DeepLearning
Nick Craswell@nick_craswell
Announcing: TREC 2022 Deep Learning Track guidelines! Deadline: August 10. This year we'll focus on comprehensive judging of passage runs. Evaluate document runs based on presence of relevant passages. Focus on reusability of the test collection. microsoft.github.io/msmarco/TREC-D…
English