Craig Thomson

Welcome everyone to #HumEval2024 The first session has started and our schedule can be found here. humeval.github.io/2024/programme/

Dear @SkyUK, I am a little worried about your staff. This Virtual Assistant seems to be quite possessive. Can you please confirm that your premises have not been taken over by an unruly AI.

@HuidromRudali @ThomsonSoftware @simon_mille Next in the @DCU-NLG group #INLG2004 line up: our amazing @HuidromRudali kicks off the first oral session of the main @inlgmeeting conference presentating her work on Differences in Semantic Errors Made by Different Types of Data-to-text Systems😍 aclanthology.org/2024.inlg-main…

Come join us for the #INLG2024 Tutorial on Human Evaluation of #NLProc System Quality on 24 Sep in Tokyo🗼🇯🇵!! Programme and summary paper available👇@JoaoSedoc @HuidromRudali @ThomsonSoftware @simon_mille @AdaptCentre @dcucomputing @inlgmeeting human-evaluation-tutorial.github.io

Very pleased to say we're running a Tutorial on Human Evaluation of #NLProc System Quality at #INLG2024 @inlgmeeting in September in Tokyo!! With @simon_mille @ThomsonSoftware @JoaoSedoc @HuidromRudali #DCUNLP 1/2

Good news everybody! You have an extra 7 days to prepare you submissions for #INLG2024! Please let everyone you know know! The new deadline for Friday, 7th of June 11:59 PM AOE! inlg2024.github.io/calls.html

All of the papers from #HumEval2024 will appear in the ACL Anthology aclanthology.org

Welcome everyone to #HumEval2024 The first session has started and our schedule can be found here. humeval.github.io/2024/programme/

We now have Mohamed Elaraby presenting their work on "Adding Argumentation into Human Evaluation of Long Document Abstractive Summarization: A Case Study on Legal Opinions". #HumEval2024.

Another poster from our ReproHum partners at Heriot-Watt. Many of these posters, including this one, are work towards the multi-lab multi-test study of the ReproHum project. reprohum.github.io

Great poster session at #HumEval24 for #ReproNLP2024, here are the posters and paper titles; papers should be on ACL Anthology shortly.

Really good poster presentation by @PSchmidtova and @LangoMateusz on their #HumEval2024 paper "ReproHum #0043-4: Evaluating Summarization Models: investigating the impact of education and language proficiency on reproducibility"

Great poster presentation by @j_corbelle on their poster "ReproHum #0927-3: Reproducing The Human Evaluation Of The DExperts Controlled Text Generation Method"

Really good poster presentation by @anouckbragg. Poster title: "ReproHum: #0033-03: How Reproducible Are Fluency Ratings of Generated Text? A Reproduction of August"

Excellent poster presentation by Toky Raboanary on their reproduction work with @nqongeveg and Maria Keet. Poster is "ReproHum #0866-04: Another Evaluation of Readers' Reactions to News Headlines"

Great poster presentation by Andra-Maria Florescu and Marius Micluta-Campeanu for #HumEval2024. "Once Upon a Replication: It is Humans' Turn to Evaluate AI's Understanding of Children's Stories for QA Generation".

Great poster by @MichelaLorandi at #HumEval2024. "Reproducing the Metric-Based Evaluation of a Set of Controllable Text Generation Techniques"

"ReproHum #1018-09: Reproducing Human Evaluations of Redundancy Errors in Data-To-Text Systems", Great poster by Filip Klubička @lemoncloack.

"Exploring Reproducibility of Human-Labelled Data for Code-Mixed Sentiment Analysis". Great virtual presentation by @heysachins. An interesting reproduction of both a training corpus and the classifiers which are then trained on it.

Very pleased to have as our second invite talk, Ding Wang from Google Research. The talk is on "All That Agrees Is Not Gold: Evaluating Ground Truth and Conversational Safety". #HumEval2024

@anyabelz is now presenting the results of the ReproNLP challenge repronlp.github.io #HumEval

We now have Toky Hajatiana Raboanary presenting their reproduction of aclanthology.org/2022.acl-long.… #HumEval2024