Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) (@clefourrier) - Twitter Profili

Sabitlenmiş Tweet

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·3 Ara

Hey twitter! I'm releasing the LLM Evaluation Guidebook v2! Updated, nicer to read, interactive graphics, etc! huggingface.co/spaces/OpenEva… After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D (back @huggingface in Dec *2026*) See you all next year!

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) tweet media

English

23

165

994

242K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·3 May

@valentina__py There was a very cool prez by @haileysch__ somewhere iirc!

English

0

2

327

Valentina Pyatkin@valentina__py·3 May

Is anyone aware of good resources/slides for a lecture on 'evaluation of LLMs' (pre-training & post-training)?

English

6

3

51

9.2K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) retweetledi

Jimmy Lin@lintool·5 Ara

👀Introducing a brand new @yupp_ai SVG leaderboard ranking frontier models on the generation of coherent and visually appealing SVGs! Gemini 3 Pro by @GoogleDeepMind takes the crown as the most powerful model! 👏 We’re also releasing a public SVG dataset. Details in🧵

English

32

65

453

70.3K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂) retweetledi

François Chollet@fchollet·4 Ara

Either you crack general intelligence -- the ability to efficiently acquire arbitrary skills on your own -- or you don't have AGI. A big pile of task-specific skills memorized from handcrafted/generated environments isn't AGI, not matter how big.

Dwarkesh Patel@dwarkesh_sp

New post: Thoughts on AI progress (Dec 2025) 1. What are we scaling?

English

103

111

1.2K

118.6K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@swyx @huggingface The "time" subset of GAIA2, very tricky for models atm - and we'll probably see very, very good progress on games based benchmarks (with stronger game based benchs coming out) But my biggest prediction is that the main trend of 2026 will be ML for science ^^ (so mb benchs there)

English

0

2

95

swyx@swyx·4 Ara

@clefourrier @huggingface what is your bet on what benchmarks will be “solved” by the time you get back? fun prediction exercise

English

1

0

124

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·3 Ara

Hey twitter! I'm releasing the LLM Evaluation Guidebook v2! Updated, nicer to read, interactive graphics, etc! huggingface.co/spaces/OpenEva… After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D (back @huggingface in Dec *2026*) See you all next year!

English

23

165

994

242K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@swyx @huggingface The hike in itself is probably going to take 6 months but I need to prepare physically before (and do some random stuff, like paragliding and seeing friends ^^)

English

1

0

1

405

swyx@swyx·4 Ara

@clefourrier @huggingface thats an ultra long hike!!! congrats

English

1

0

1

423

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@Teknium @huggingface Thanks a lot! You can always follow @nathanhabib1011 , he's the one taking over all our cool eval stuff (lots of very, very neat things coming up btw)

English

0

2

748

Teknium 🪽@Teknium·4 Ara

@clefourrier @huggingface I’ll miss your work in the meantime!

English

1

0

3

1.2K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@codewithimanshu @huggingface Probably! It will be fun to see then :)

English

0

334

Himanshu Kumar@codewithimanshu·4 Ara

@clefourrier @huggingface Cheers to your sabbatical, Clementine! That's a long break, but I wonder if the tech will change much by then, eh?

English

1

0

1

403

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@mziizm @huggingface Thanks a lot! :)

English

0

1

374

Marzieh Fadaee@mziizm·4 Ara

@clefourrier @huggingface Enjoy the break!

English

1

0

2

543

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@maximelabonne Thanks a lot :)

English

1

0

2

403

Maxime Labonne@maximelabonne·3 Ara

You don't understand evals Everybody in AI should read this 👇

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier

Hey twitter! I'm releasing the LLM Evaluation Guidebook v2! Updated, nicer to read, interactive graphics, etc! huggingface.co/spaces/OpenEva… After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D (back @huggingface in Dec *2026*) See you all next year!

English

4

45

580

155.6K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@altryne @nisten no problem! my pic is def gender neutral ^^"

English

0

31

Alex Volkov @ AI Engineer@altryne·4 Ara

@nisten @clefourrier ooops, good to know!

English

1

0

2

82

nisten🇨🇦e/acc@nisten·3 Ara

mf just dropped another book banger

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier

Hey twitter! I'm releasing the LLM Evaluation Guidebook v2! Updated, nicer to read, interactive graphics, etc! huggingface.co/spaces/OpenEva… After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D (back @huggingface in Dec *2026*) See you all next year!

English

1

0

27

5.1K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@giffmana @huggingface Thanks a lot, I'm super excited about it :D (so much to do, so little time ^^)

English

0

1

478

Lucas Beyer (bl16)@giffmana·4 Ara

@clefourrier @huggingface Enjoy the long break, sounds awesome!

English

1

0

2

1.4K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@TheOkosisi @huggingface Feel free to cite it as you need! :)

English

0

338

Lucas Atkins@latkins·4 Ara

GIF

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier

Hey twitter! I'm releasing the LLM Evaluation Guidebook v2! Updated, nicer to read, interactive graphics, etc! huggingface.co/spaces/OpenEva… After this, I'm off: I'm taking a sabbatical to go hike with my dogs :D (back @huggingface in Dec *2026*) See you all next year!

ZXX

1

2

22

10.2K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@latkins Hahahahahaha 💯 my mood when writing the tweet XD

Filipino

0

1

105

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@nisten @altryne I hope you'll be in a year ^^ (she or they btw XD)

English

1

0

3

68

nisten🇨🇦e/acc@nisten·3 Ara

@altryne yeah we’ll not be done reading it by the times he’s back

English

1

0

2

82

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·4 Ara

@xeophon @huggingface Thanks a lot :)

English

0

1.8K

Florian Brand@xeophon·3 Ara

@clefourrier @huggingface Holy shit!!! Time to check it out 👀 Have fun with your dogs!!

English

1

0

3

2.5K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·3 Ara

@huggingface cc @maximelabonne since you wanted an update :P

English

1

0

12

3.6K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·3 Ara

If you see improvements, I'd love to hear them (within the next 2 days) :) Many thanks to @thibaudfrere for his help on the banner and @gui_penedo for his proofreading! If you've got eval needs, your new PoC is @nathanhabib1011 (with a focus on lighteval)!

English

1

0

21

5K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)@clefourrier·3 Ara

The guide is very beginner friendly, as we go from the basics of tokenization/inference to the nits and tricks of running eval properly, so it's compatible with all levels. Should contain most of what we wrote about evals at HF in a single unified place, with updates ofc :)

English

1

29

6.8K

Clémentine Fourrier 🍊 is off till Dec 2026 (🪂)

Keşfet