Delta

1.5K posts

Delta banner
Delta

Delta

@DeltaCommunityX

Delta is a community of researchers and engineers.

Katılım Şubat 2025
1.7K Takip Edilen4.1K Takipçiler
Delta
Delta@DeltaCommunityX·
🚨 Headed to ICML 2026? Come hang out with friends at a Michelin Star restaurant to celebrate the end of the main conference!! Huge thanks to our friends at @Gen_Intuition for co-hosting this with us!
Delta tweet media
English
1
3
34
14.2K
Delta retweetledi
Andrew M. Dai @ ICML
Andrew M. Dai @ ICML@AndrewDai·
Looking forward to seeing everyone at @ElorianAI's rooftop dinner in Seoul at ICML this evening co-hosted with @RicursiveAI, @strikervp and @DeltaInstitutes. Sign-up if you haven't already!
Delta@DeltaCommunityX

🚨 Headed to ICML 2026? Come hang out with friends at a rooftop dinner with a DJ to celebrate the start of the main conference!! Huge thanks to our friends at @ElorianAI, @RicursiveAI, and @StrikerVP for co-hosting this with us!

English
0
4
16
3K
Delta
Delta@DeltaCommunityX·
@jxmnop Congrats, Jack!!
English
0
0
3
495
Jack Morris
Jack Morris@jxmnop·
my paper won an award at icml 😁 some thoughts: • this work was rejected from NeurIPS. i cleaned it up a small amount and it got great reviews from ICML! don't give up • ICML received 24k submissions and only gives out 7 awards, which is crazy. feeling grateful • i distinctly remember sitting at my desk two winters ago wondering if i would ever finish this project. most of all this is the product of sitting down and forcing myself to keep working for several months straight. the results emerged from running the experiments over and over and fixing a long sequence of tiny details. eventually, the curves looked like that 👇 • also happy that the insights in this paper are becoming more widely accepted: 3.3 bits/param, thinking about capacity "LLM as flashdrive" mentality • the method here is used successfully for selecting midtraining data at least one frontier lab, which is cool! • i am grateful to my collaborators, but Meta is no longer a great place for academic research imo and this almost never got published for a number of reasons. i shall not elaborate further • for future work, i think analyzing the implications of on-policy algorithms on capacity, as well as LoRA and things like it, are fruitful potential research directions • sadly i'm not in Korea but am following the conference online from california and happy to chat! a nice end to one phase of my research career :)
Jack Morris@jxmnop

new paper from our work at Meta! **GPT-style language models memorize 3.6 bits per param** we compute capacity by measuring total bits memorized, using some theory from Shannon (1953) shockingly, the memorization-datasize curves look like this: ___________ / / (🧵)

English
94
138
2.8K
322.7K
Delta
Delta@DeltaCommunityX·
🚨 Headed to ICML 2026? Come hang out with friends at a rooftop dinner with a DJ to celebrate the start of the main conference!! Huge thanks to our friends at @ElorianAI, @RicursiveAI, and @StrikerVP for co-hosting this with us!
Delta tweet media
English
1
2
18
4.6K
Delta
Delta@DeltaCommunityX·
🚨 Headed to ICML 2026? Come hang out with friends at a Michelin Star restaurant to celebrate the end of the main conference!! Huge thanks to our friends at @Gen_Intuition for co-hosting this with us!
Delta tweet media
English
1
6
22
6.2K
Michael Psenka
Michael Psenka@michaelpsenka·
update thread! 🧵 In May I defended my PhD thesis, titled “Variational Approaches to Path Problems in Deep Learning”. I could not be more grateful for my advisor @ask1729 , my committee @akanazawa, @pabbeel, and @ylecun, and all of my other mentors, collaborators, and friends along the way. Thank you all for making this such an enriching PhD.
Michael Psenka tweet media
English
14
1
77
6.5K
Victoria X Lin
Victoria X Lin@VictoriaLinML·
The video of my Stanford CS25 guest lecture, From Language Models to Native Multimodal Intelligence, is now online. I discussed how the core ideas behind LLMs has shaped multimodal AI, from architectures to training paradigms and scaling, and where the next challenges may lie. 🧠🌐 🎥: youtube.com/watch?v=NDdc39…
YouTube video
YouTube
English
24
193
1.6K
232.9K
Delta
Delta@DeltaCommunityX·
🇰🇷 Headed to ICML 2026? Come hang out with our friends at @RicursiveAI, @ElorianAI, and @StrikerVP to celebrate the start of the main conference!!
Delta tweet media
English
1
3
13
1.6K