TREC Conversational Assistance Track

A reminder that the topics Y4 are available Conversational Assistance Track (CAsT) : github.com/daltonj/trecca… New this year: (1) Different topic format, (2) Mixed-Initiative system responses (3) Complex discourse structures. @JeffD @JTrippas @maliannejadi @leifos @ogbonokopaul

All the past judgments and topic files are in the website github repository (including the 2021 judgments). github.com/daltonj/trecca…

The guidelines information for CAsT Y4 are available: treccast.ai. The collections are all available, including deduping for MS MARCO V2. The mixed initiative deadline is August 15th. The main task deadline is August 31th. Be sure to register! #TREC2022

Get ready to participate in CAsT Y4. Be sure to register - ir.nist.gov/trecsubmit.ope… #trec2022 #ConversationalAI

And a reminder that the submission deadline is August 18th (AOE).

Last week we posted updates to treccast.ai with additional resources and tools (github.com/grill-lab/trec…) for 2021, including automatic baseline runs and converted corpora. See a summary and ask questions on the mailing list: groups.google.com/g/trec-cast #trec2021

We've been working on baselines and topic development. The #TREC2021 evaluation topics will be released very soon, hopefully in time for your July 4th BBQ. Stay tuned to social media of your choice.

A reminder that to participate in CAsT you MUST register. The registration form: ir.nist.gov/trecsubmit.ope… The official deadline for CAsT 2021 submission will be August 18th.

We'll be having an virtual open planning session for Y3 Thursday 18th of February. Please join us! It will be held 5:00pm - 6:00pm GMT (London). Zoom link: uofglasgow.zoom.us/j/91819339028 Magic word for meeting is "trec".

We're exciting to be planning for the TREC Conversational Assistance Track in #trec2021. We would like your help and feedback to make next year more relevant for your research. bit.ly/trec-cast-y2 #trec2020 #conversationalai #SCAI_Workshop #EMNLP2020

We look forward to seeing all participants at the TREC virtual conference. For CAsT teams - please send us a talk title, a brief abstract, and the name of the presenter ASAP (by October 20th) so that we can arrange a talk slot. #treccast #trec2020

We're excited to announce that TREC Conversational Assistance Track will continue in 2021. Please attend TREC (virtually this year) and participate in our planning discussion for next year. #trec2020 #trec2021

Today is the TREC CAsT submission deadline for #TREC2020. We look forward to your submissions! Please contact us on the mailing list if you encounter any last minute issues. The exact deadline is today the 19th 'roughly' AOE - 'early morning' Eastern (NIST time) on the 20th.

Today at 10:05 PDT,19:05 CET @earissola will present our work on TREC CAsT at #CHIIR2020,with @Dull_Dude there to answer your questions.Don't miss the very first paper on @treccast 😉 where we study the evolution of its conversations and how it can be modeled. #SIGIR2020 #NLProc

There's still time to participate in TREC CAsT 2020 - the deadline for submission is August 19th. Find us at #sigir2020 to discuss and also see a bunch of papers using CAsT-19 data.

Congratulations to the authors of the #sigir2020 best short paper on Conversational Query Rewriting with TREC CAsT: Few-Shot Generative Conversational Query Rewriting arxiv.org/abs/2006.05009 Code: github.com/thunlp/Convers… This is the baseline rewriter used in CAsT Y2.

Come join us in two hours for information on the CAsT-19 dataset short paper discussion. sigir-schedule.baai.ac.cn/poster/sp0025 #sigir2020

TREC CAsT Year 2 is well under way. There are lots of updates on our website treccast.ai including the 2020 evaluation topics, baseline GPT-2 + BERT runs, and a web UI with BERT to explore. Reminder that the submission deadline is August 19th. #treccast #trec2020

There will be lots of research on #conversationalsearch at #sigir2020. We're happy to announce that this includes a short paper on the CAsT dataset construction - "CAsT-19: A Dataset for Research on Conversational Information Seeking" w/ @JeffD @JamieCallan and @XiongChenyan

In case you missed it, the TREC Conversational Track overview is available in the TREC proceedings and on arXiv. With @JeffD @JamieCallan and @XiongChenyan arxiv.org/abs/2003.13624 Start preparing for TREC CAsT 2020! #trec2019 #trec2020