Klara Kaleb

Excited to be in Singapore for #ICLR2025! 🇸🇬 Looking forward to chatting about open-endedness and the automation of innovation & discovery!! Find our work at: ➡️ Poster: Intelligent Go-Explore ⏰ Thu, 3-5:30 PM | 📍 Hall 3+2B #282 @shengranhu @jeffclune ➡️ Poster: Automated Design of Agentic Systems ⏰ Sat, 3-5:30 PM | 📍 Hall 3+2B #275 @shengranhu @jeffclune ➡️ Talk @ CVML-GenAI Workshop (SMU): Towards Fully Autonomous Open-Ended Scientific Discovery ⏰ Sun, 2:25 PM ➡️ Invited Talk @ ICBINB Workshop: The AI Scientist-v2 ⏰ Mon, 2:00 PM | 📍 Hall 4 #1 @_yutaroyamada @RobertTLange @shengranhu @_chris_lu_ @j_foerst @jeffclune @hardmaru 🗣️ Building Trust Workshop Oral: StochasTok ⏰ Mon, 4:20 PM | 📍 Hall 4 #6 @anyaasims Thom Foster @klarakaleb @j_foerst @yeewhye

Our paper on the best way to add error bars to LLM evals is on arXiv! TL;DR: Avoid the Central Limit Theorem -- there are better, simple Bayesian (and frequentist!) methods you should be using instead. Super lightweight library: github.com/sambowyer/baye… 🧵👇

📣 Jobs alert: UQ in LLMs! We're looking to hire a Postdoctoral Fellow and a Research Engineer to work on uncertainty quantification in LLMs. The project is a collaboration between @UniofOxford (@yeewhye), @NTUsg (Luke Ong) and @NUSingapore (@WeeSunLee) #LLMs #hiring #academic #UQ Details ⬇️

Couldn't agree more. "UK Research and Innovation funding in the UK fell under the previous government from 6,835 in 2018-19 to 4,900 in 2022-23". To give a concrete example (with my @UCLCS professor hat on): 4 out of 7 @UCL_DARK PhD students were funded by the Centre for Doctoral Training (CDT) in Foundational AI at @ai_ucl. @akbirkhan @LauraRuis @_robertkirk @PaglieriDavide won Best Paper Awards at international top-tier conference, made significant contributions to AI safety, expanded our understanding of how LLMs learn to reason, and built difficult evaluations of agentic capabilities of LLMs while many other benchmarks are saturating. @UCL_DARK alumni start startups (@WecoAI), work in leading AI labs like @GoogleDeepMind, @AnthropicAI, @AIatMeta, or work in government at @AISafetyInst. @UCL_DARK wouldn't be what it is today without that CDT funding. Yet, despite the tremendous success of the @UCL Centre for Artificial Intelligence, the CDT was discontinued. @UCL_DARK now has six open positions for AI PhDs to start in Fall 2025, and it's unclear whether we will be able to make any funded offers. In turn, our lab is already significantly scaling down MSc thesis supervision, and thus not doing as much as we would like to train the next generation of AI experts. It the UK wants to have any chance at keeping up with AI, PhD funding, in addition to securing significant compute for academic research, should be their top two main priorities. Without these, the "talent" in the talent pipeline is missing. While we are at it, the starting salary for an assistant professor in the UK is in the range of £50K-60K which simply is not enough to attract international top faculty in AI to the UK. The third priority should be topping up AI postdoc and faculty salaries. ft.com/content/a65659…