NLI4CT

Fine-tune your LLM unless you have access to GPT-4! In our SemEval 2024 @NLI4CT solution, we evaluated LLMs with ICL, CoT, and a novel PEFT method. And yet, GPT-4 produces surprisingly good results, ranking joint-first in the leaderboard! 👉 arxiv.org/abs/2404.00484 🧵 1/9

80+ participants have already signed up for the Safe Biomedical Natural Language Inference for Clinical Trials Task @SemEvalWorkshop! With one week still to go for the practice task, it's the perfect time to jump in. Join us now on codalab.lisn.upsaclay.fr/competitions/1…. #SemEval #NLPChallenge

This task aims to probe the robustness, consistency, and faithfulness of LLMs in clinical NLI, which is pivotal for advancing real-world applications, especially in the critical domain of healthcare. Visit sites.google.com/view/nli4ct/ for more details.

We are glad to announce SemEval 2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials. Register here to participate codalab.lisn.upsaclay.fr/competitions/1…. @SemEvalWorkshop @mrc_valentino #HealthcareAI #ClinicalTrials

The CodaLab Competition for @SemEvalWorkshop Task 7 - NLI4CT Multi-evidence Natural Language Inference for Clinical Trial Data is now available! #learn_the_details" target="_blank" rel="nofollow noopener">codalab.lisn.upsaclay.fr/competitions/8… GitHub: github.com/ai-systems/nli… Website: sites.google.com/view/nli4ct/