BIU NLP
226 posts
@biunlp
The Bar-Ilan University, Natural Language Processing group.
Excited to share GenerationPrograms! 🚀 How do we get LLMs to cite their sources? GenerationPrograms is attributable by design, producing a program that executes text w/ a trace of how the text was generated! Gains of up to +39 Attribution F1 and eliminates uncited sentences, and it can be used for refinement as well as post-hoc attribution! 🧐 Motivation: LLMs often generate impressive text but struggle to cite their sources accurately, leading to unverifiable claims and "hallucinations". As shown in our example (left), baseline methods can produce missing or incorrect citations. How do we ensure faithfulness? A thread 🧵👇
🚀 New paper out! 📜 Tackling a long-standing challenge in text summarization: How do we properly conduct human evaluations to improve its systematicity, granularity, and scalability? 🤔 Let’s dive in. 🧵👇 📖 Read the full paper here: arxiv.org/abs/2412.07096
I’m excited to share that I'm joining Bar-Ilan University as an assistant professor!
🚨 New paper alert! 🚨 We propose an IQ Test for LLMs — a new way to evaluate models that goes beyond benchmarks and uncovers their core skills. Think: 🧠🤖 psychometrics for LLMs. 👇 (1/6)
🚨 New paper alert! 🚨 We propose an IQ Test for LLMs — a new way to evaluate models that goes beyond benchmarks and uncovers their core skills. Think: 🧠🤖 psychometrics for LLMs. 👇 (1/6)
