MSMarco

2

5

515

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·15 Kas

If you are at #TREC2023 this morning, then come down to room 3-CD for the TREC Deep Learning Track workshop and don't forget to pick up a TREC Deep Learning Track 5 year celebration sticker!

English

2

7

774

MSMarco@MSMarcoAI·12 Kas

Fifth and final year of the #TREC Deep Learning Track. What an amazing journey this has been, thank you one and all! 🙏 #TREC2023 #TRECDL #TREC2023DL

On my way to #TREC2023. ✈️ This is the 1st year of the Tip-of-the-Tongue (ToT) Track and the 5th (& final) year of the Deep Learning (DL) Track. Looking forward to seeing many of you in-person for the first time since the pandemic! #TREC #TRECToT #TRECDL #TREC2023TOT #TREC2023DL

English

2

8

1.8K

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·24 Tem

🔔 Reminder: The deadline for run submissions for the TREC 2023 Deep Learning Track is in 1 WEEK! #TRECDL #TREC2023DL

⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL Guidelines and more info: microsoft.github.io/msmarco/TREC-D…

English

4

3

984

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·19 Tem

⌛Gentle reminder: #TREC2023DL Track run submission deadline is **JULY 31**. Get your run submissions in before the deadline! #TRECDL Guidelines and more info: microsoft.github.io/msmarco/TREC-D…

GIF

Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…

English

2

1.5K

MSMarco retweeté

Hossein A. (Saeed) Rahmani@srahmanidashti·12 Tem

We are pleased to announce that we have released the test queries for the TREC 2023 Deep Learning Track. This year, we have some 'synthetic' queries to explore whether we can glean insights about system performance using queries generated by LLMs. #TREC #TREC2023DL

Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽 Guidelines and more info: microsoft.github.io/msmarco/TREC-D…

English

4

18

1.5K

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·10 Tem

Are you planning to participate in the TREC 2023 Deep Learning Track? We have just released the test queries! 🙌🏽 #TRECDL #TREC2023DL Run submission deadline is **JULY 31** (in exactly 3 weeks) 👈🏽 Guidelines and more info: microsoft.github.io/msmarco/TREC-D…

Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…

English

2

8

2.4K

MSMarco retweeté

Nick Craswell@nick_craswell·10 Tem

Announcing: Test queries for the TREC 2023 Deep Learning Track are now available, along with top-100s for (optional) use in reranking. #TRECDL #TREC2023DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…

English

8

12

2.6K

MSMarco@MSMarcoAI·9 Haz

🔔We are back up again. Sorry ya'll for any inconvenience caused by this.

MSMarco@MSMarcoAI

⚠️There is a small ongoing configuration issue with our Azure storage account because of which the MS MARCO and related datasets are currently not accessible. We are actively working on this and hope to bring it back up soon. Sorry for the inconvenience!

English

2

606

MSMarco@MSMarcoAI·9 Haz

⚠️There is a small ongoing configuration issue with our Azure storage account because of which the MS MARCO and related datasets are currently not accessible. We are actively working on this and hope to bring it back up soon. Sorry for the inconvenience!

English

0

1

779

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·18 May

The TREC-DL Track will celebrate 5th anniversary this year.🎂 Focus will be on comprehensive passage runs judging and using those for document runs eval. Test queries to be released in June. Submission deadline: July 31st. #TRECDL #TREC2023DL Guidelines: microsoft.github.io/msmarco/TREC-D…

English

3

4

785

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·18 May

I'm co-organizing 2 TREC tracks this year: Tip-of-the-Tongue & Deep Learning. Excited that 20+ groups have already registered for each. 🙌🏽#TREC2023 #TREC2023ToT #TREC2023DL #TRECToT #TRECDL Please Register: ir.nist.gov/trecsubmit.ope… Also, guidelines for both tracks are now online.

English

4

13

2.1K

MSMarco@MSMarcoAI·1 Mar

Important 🧵

Thanks for raising this @macavaney! This is a very important conversation relevant to 3 evaluation scenarios that are worth discussing separately: 1. TREC-DL 2023 2. MS MARCO ranking leaderboard 3. Private evaluation for papers using MS MARCO / TREC-DL data A quick thread... 🧵

English

TREC Tip-of-the-Tongue Track@TREC_ToT

1

217

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·23 Şub

Super excited about #TREC'23!🙌🏽 This year is the 5th anniversary🎂 of the Deep Learning Track. #TRECDL I'm also co-organizing the Tip-of-the-Tongue Track, #TRECToT the cool new track😎 at TREC w/ complex and ambiguous information needs. Please participate! trec.nist.gov/pubs/call2023.…

We're organizing The Tip-of-the-Tongue (ToT) Track at #TREC, a shared task on known-item identification where the searcher cant recall a reliable identifier (It’s on the tip of my tongue…) Follow us for announcements/updates and dont forget to participate in the track! #TRECToT

English

5

18

1.6K

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·15 Kas

Quick follow-up: Here's our poster summarizing the TREC 2022 Deep Learning track. #TREC2022DL #TREC2022 #TRECDL

English

2

5

0

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·14 Kas

Was a pleasure to present the 4th Deep Learning Track overview at #TREC2022. We had healthy track participation and observed bigger gaps between trad. and NN based methods, and better distribution of system performances across queries. #TREC2022DL #TRECDL microsoft.github.io/msmarco/TREC-D…

English

5

32

0

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·16 Eyl

Slides from my recent invited talk @SpotifyResearch reflecting on benchmark development, community building, and robust scientific progress based on my experience working on @MSMarcoAI and TREC Deep Learning Track. slideshare.net/BhaskarMitra3/… Thank you @CharlotteHase for hosting me!

English

2

5

36

0

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·18 Tem

TREC 2022 Deep Learning Track test queries (+ top-100 candidates for reranking subtask) has been released.📣 #TREC2022DL #TREC2022 Run submission deadline: *Aug 10* More info: microsoft.github.io/msmarco/TREC-D… Please RT.

Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…

English

6

11

0

MSMarco retweeté

Nick Craswell@nick_craswell·18 Tem

Announcing: Test queries for the TREC 2022 Deep Learning Track are now available, along with (optional) top-100 candidates for both document and passage ranking. #TRECDL #TREC2022DL @MSMarcoAI microsoft.github.io/msmarco/TREC-D…

English

9

24

0

MSMarco retweeté

Bhaskar Mitra | ভাস্কর মিত্র@UnderdogGeek·13 Haz

📣TREC 2022 Deep Learning Track submission guidelines are out: microsoft.github.io/msmarco/TREC-D… Submission deadline: Aug 10 This will be the second year using the V2 collection. Test queries are coming soon! #TREC #TREC2022 #TREC2022DL #MSMARCO #DeepLearning

Announcing: TREC 2022 Deep Learning Track guidelines! Deadline: August 10. This year we'll focus on comprehensive judging of passage runs. Evaluate document runs based on presence of relevant passages. Focus on reusability of the test collection. microsoft.github.io/msmarco/TREC-D…

English