Jack Valmadre

AI has now solved a major open problem -- one of the best known Erdos problems called the unit distance problem, one of Erdos's favourite questions and one that many mathematicians had tried. openai.com/index/model-di…

@hasumpstuffedup Please don't!

I'm getting close to giving up on this account. HTB officiation absolutely shocking tonight (and not just that) The poor umpiring at the AFL level is starting to ruin games. Both games this weekend officiated appallingly #AFLTigersDees

Congratulations to @HarmonicMath on their $1.45B valuation! Their approach of requiring AI to "output reasoning as [Lean] code instead of reasoning as English" is exactly the type of effort the @VentureBeat highlighted this week when it stated "Lean4 adds a layer of trust on top of AI outputs." Harmonic new valuation: reuters.com/business/robin… VentureBeat article: venturebeat.com/ai/lean4-how-t…

@DimitrisPapail Smooth, grows linearly away from zero, invariant to constant addition i.e. depends on relative difference not absolute value (Considering the composition of cross-entropy and softmax, to be more precise)

Why is cross-entropy a good loss for language pretraining? I do think it is, but I am curious what is the commonly accepted intuition behind it.

We are proud to be Releasing NuminaMath-LEAN, a large-scale dataset of 100K mathematical competition problems formalized in Lean 4, with more than 20K human annotations. Paired with Kimina-Prover, Kimina-autoformalizer, CombiBench, we hope these data and models will advance open-source AI for formal mathematics ! This year's IMO was bittersweet for Numina as our theorem prover did not solve any problem, we believed we were very close. Numina is starting a new chapter after IMO 2025. While we will still continue to build SOTA open source theorem prover for high school problems, we would also like to branch out and explore undergraduate level math or even research level, open mathematical problems. #AI4Math #FormalMath #LeanProver #AutomatedReasoning #TheoremProving #ProofAssistant #MachineLearning #AIResearch #OpenScience #Lean4 #LeanLang

PS People seem to be quite excited that now LLMs are doing this on their own, without being “supercharged” by Lean. I’m not. The great thing about LLMs is the large quantity of text they can produce, and the speed with which they produce it. But my goal has always been pure mathematics, and understanding. I see formalization as a tool to help ease some of the technical (boring but important) challenges of proving theorems (and sometimes the fireworks are all in the technicalities!..). But formalization is itself currently very time consuming and labor intensive - that’s where AI can come in. So for my money, formalization is in service of mathematics, and AI is in service of formalization. I don’t care if an LLM can spit out a hundred papers a day, even if they’re mostly right; if they’re not formalized, I’m not going to bother looking at them, trying to sort through which are right or not. So while others see LLMs reasoning without formalization as a “win” (and it is one, for LLM technology), I’m personally not as interested, since it doesn’t directly serve my ultimate goal.

Woohoo!! The "Medium" strength Prime Number Theorem was just proved in @leanprover Lean: (the bottom node in the picture is Green) The main `MediumPNT` file is about 8000 lines of code, which uses a big `ZetaBounds` file with around 4000 lines of code, and another ~1000 lines for residue calculus on rectangles. It was remarkably fun to collaborate with dozens of people, the vast majority of whom I've never met (and likely will never meet; some are math students, others are, e.g., software engineers doing some Mathlib just for fun on the weekends...), and knowing with *certainty* that their contributions are solving the tasks I set out. Quite a model for large scale math projects!

Terence Tao has released a new #LeanLang project that connects #FormalVerification with #MathematicsEducation: The companion to "Analysis I" is intended to provide a new avenue for engaging with the proofs and exercises in Tao's foundational "Analysis I" text. 👇

One more episode is out and this time we get foundational! Pierre-Marie Pédrot, a core Coq/Rocq dev join us in a conversation to define what even is Type Theory to begin with. What properties should we care about and why!? typetheoryforall.com/episodes/type-…

"Oops, I Sampled It Again": Recent paper in TMLR 2024 by student Raphaël Lafargue which demonstrates that existing confidence intervals in few-shot learning benchmarks are fundamentally flawed: They sample tasks *with replacement* and then compute variance assuming independence..

Joao Henriques (joao.science) and I are hiring a fully funded PhD student (UK/international) for the FAIR-Oxford program. The student will spend 50% of their time @UniofOxford and 50% @AIatMeta (FAIR), while completing a DPhil (Oxford PhD). Deadline: 2nd of Dec AOE!!

I'm talking at a conference later this year (on UX+AI). I just saw an ad for the conference with my photo and was like, wait, that doesn't look right. Is my bra showing in my profile pic and I've never noticed...? That's weird. I open my original photo. No bra showing. I put the two photos side by side and I'm like WTF... Someone edited my photo to unbutton my blouse and reveal a made-up hint of a bra or something else underneath. 🤨 Immediately, I email the conference host. (FYI he is a great, respectable guy with 5 kids at home.) He is super apologetic and immediately looks into the issue. He quickly reports back that the woman running their social media used a cropped square image from their website. She needed it to be more vertical, so she used an AI expand image tool to make the photo taller. AI invented the bottom part of the image (in which it believed that women's shirts should be unbuttoned further, with some tension around the buttons, and revealing a little hint of something underneath). 🤯 — FYI the conference organizers were super apologetic and took down all of the content with that photo.

#ECCV2024 is on ! Check out our work on learning from noisy datasets where we observe that detecting out-of-distribution training images using unsupervised learning discards highly important clean examples and how to recover them. @insight_centre @TheAIML eccv.ecva.net/virtual/2024/p…

✨The VOTS2024 Panel✨ will discuss the future of tracking and of VOTS. Drop your questions you'd like to see discussed in the comments below 👇. The most intriguing🧐 question posted by 28.9. 18h CET will be rewarded a limited-edition VOTSgift🃏 ! 🎁 #VOTS2024 #AskThePanel

The University of Adelaide and CommBank have announced a partnership to establish the CommBank Centre for Foundational Machine Learning Research. The centre will position South Australia as a leader in foundational AI research. Click to read ➡️adelaide.edu.au/aiml/news/list…

1/ Can AI scaling continue through 2030? We examine whether constraints on power, chip manufacturing, training data, or data center latencies might hinder AI growth. Our analysis suggests that AI scaling can likely continue its current trend through 2030.

@miniapeur Also try counting breaths down from 100 to help fall asleep

@miniapeur Listen to the Huberman podcast on sleep. Go outside for 10 mins after waking up, no coffee for the first 2 hours, go for a walk at dusk. I had similar issues and it helped me within a few days. hubermanlab.com/episode/master…

I haven't really slept in four days. I go to bed at about 10:30 pm and get up at 7:00 am. But I have trouble sleeping and I wake up several times (between 3 and 5). Strangely enough, I'm always thirsty at night. And the little sleep I get isn't very restorative. Any ideas?

@WarnieDT Oliver, Ryan, Sexton, McKercher, Day

Who are the FIVE 'weakest' links in your #AFLFantasy Classic team? ie. the five on-field players you would trade out next given the opportunity (pre-R16 trades). Mine: Oliver, Salem, Powell, Simpkin, Sexton.

@AFLFantasy Feels like last year I got burnt in the byes by trying to have 22 green dots and not enough premiums. Now have a little over 300k left to spend on my 3rd trade and tossing up between Zach Reid → Hind or Soligo → Serong. What do you reckon? Thanks!

The Traders will be sitting down to discuss about an eventful round 11 for the Official #AFLFantasy Podcast on Monday! If you've got a question, shoot it through now! Don't miss the podcast when it drops: Spotify - bit.ly/TradersSpotify Apple - bit.ly/TradersiTunes