SUMEval @ COLING 2025

11 AM GST: Panel Discussion-1: Challenges of Collecting Culturally Grounded Multilingual Data for Training and Evaluation of NLP Systems.

SumEval-2 is happening today at ADNEC, Abu Dhabhi. Looking forward to meeting all the participants!

**Archival Submission Deadline** Reminder to submit your archival submissions by Nov 8th, 2024 (AOE) Submission Link: softconf.com/coling2025/SUM… Please check our website for more details: sites.google.com/view/sumeval-2… or contact us at sumeval2025@gmail.com

Softconf Submission Link: softconf.com/coling2025/SUM… Please check our website for more details: lnkd.in/gqb--HmT or contact us at sumeval2025@gmail.com

Thanks to Microsoft for their generous sponsorship for their cash awards.

** Updates ** * We are excited to announce that, there will be cash awards for two best papers, one for archival and one for non-archival track * We are extending the archival submission deadline to Nov 8, 2024 (no changes to the non-archival submission deadline Nov 25, 2024)

@nlp_survey Regarding your second question, if you are also submitting to COLING it will not be included in the proceedings, but you can present it during the workshop.

@nlp_survey @nlp_survey the theme of your work could match with several areas that we are targeting within the workshop (i.e. Studies on scaling up multilingual and multicultural evaluation, Data sets, benchmarks, or libraries for evaluating multi-lingual models etc.).

***SumEval Archival Submission Deadline*** Archival Submission: October 18th, 2024 Softconf Submission Link: softconf.com/coling2025/SUM… Please check our website for more details: sites.google.com/view/sumeval-2…… or contact us at sumeval2025@gmail.com

with: @monojitchou , @vishrav , Sunayana Sitaram, @seb_ruder , @HellinaNigatu , @OanaIgnatRo

@HellinaNigatu @OanaIgnat @seb_ruder @monojitchou @vishrav Please check our website for more details: sites.google.com/view/sumeval-2… or contact us at sumeval2025@gmail.com

@HellinaNigatu @OanaIgnat @seb_ruder @monojitchou @vishrav ***Important Dates*** Archival Submission: October 18th, 2024 Non-archival Submission: November 25th, 2024 Notification of Acceptance: December 3rd, 2024 Camera-Ready Papers Due: December 10th, 2024 Workshop Date: January 20th, 2025, co-located with COLING 2025

Announcing the second edition of SUMEval - Workshop on Scaling Up Multilingual and Multi-Cultural Evaluation of foundation models will be held in conjunction with COLING 2025. with : @HellinaNigatu , @Oanaignat, @seb_ruder, Sunayana Sitaram, @monojitchou, @vishrav

In addition to regular papers submitted to the workshop, we will also accept papers that were submitted elsewhere and papers with AACL and ARR reviews. For detailed information regarding submission instructions, please visit lnkd.in/g57vnuWC

** SumEVAL Paper Submission Deadline Extended ** We are extending the SumEVAL workshop paper submission deadline to September 23, 2022.

SUMEval workshop paper deadline has been extended to September 1st, 2022 Paper Submission Instructions: microsoft.com/en-us/research…

Test sets for all the languages (surprise + non-surprise) have now been released. Submission instructions: tinyurl.com/rjzp9b32 SUMEval shared task: aka.ms/sumeval August 15 2022: Challenge ends August 25 2022: Paper submission deadline