
I'm really excited to be delivering a seminar at @SheffieldNLP on Tuesday about my research on Small and Human-Scale Language Modeling! Thanks @_joestacey_, @_gucciiiii, Marco Valentino and @nikaletras for the invite!
Sheffield NLP
933 posts

@SheffieldNLP
Established 1993, the University of Sheffield's #NLProc Group is one of the UK's largest natural language processing research centres.

I'm really excited to be delivering a seminar at @SheffieldNLP on Tuesday about my research on Small and Human-Scale Language Modeling! Thanks @_joestacey_, @_gucciiiii, Marco Valentino and @nikaletras for the invite!




I have been studying a lot of post-training paper to prepare for my next video. This morning I am studying a banger from this week: "Where does output diversity collapse in post-training?" One of the more educational papers I have read recently. Basically after post-training LLMs often produce less varied answers than their base versions. This paper runs experiments to figure out where exactly this diversity is lost, the effects of distillation vs instruction-tuning vs RLVR, etc. Their big hypothesis is that the diversity cannot be recovered at inference through sampling techniques or CoT. The collapse irreversibly happens during training.








#SIGIR2026 accepted paper list has been released on sigir2026.org/en-AU/pages/pr… Vibe coded the analysis again based on csrankings.org (again, by no means accurate), found that this year, Renmin University continues to be the top-1 institute, and China and US are still the top-2 countries with most publications.













🎉 New paper acceptances from Sheffield NLP! Our recent work has been accepted at @eaclmeeting , ECIR , and the CLEF Lab 🚀 Check out the poster for paper titles, authors, and links to available arXiv preprints 👇





Happy to share that two papers were accepted to #ICLR2026 🎉 A perfect cure for the Monday/January blues. Big shout-out to my amazing collaborators 🙌 1️⃣ PerSpectra: A Scalable and Configurable Pluralist Benchmark @lucie_nlp 2️⃣ Tracing and Reversing Edits @@SeifertChristin



