Jeremy Cohen

1.2K posts

Jeremy Cohen banner
Jeremy Cohen

Jeremy Cohen

@deepcohen

Research fellow at Flatiron Institute, working on understanding optimization in deep learning. Previously: PhD in machine learning at Carnegie Mellon.

New York, NY Katılım Eylül 2011
992 Takip Edilen6.2K Takipçiler
Jeremy Cohen
Jeremy Cohen@deepcohen·
@nsaphra I think part of it was that he wanted his chores done for him. Bro would’ve loved AGI
Jeremy Cohen tweet media
English
2
1
16
1.6K
Jeremy Cohen
Jeremy Cohen@deepcohen·
@roydanroy Could the average person get (somewhat diluted) equity in OpenAI/Anthropic by buying MSFT/Google stock? Genuine question - I’m not a personal finance expert
English
1
0
4
1.3K
Dan Roy
Dan Roy@roydanroy·
Hot take 🔥: any company that thinks their company will reach AGI/ASI/whatever first and who is concerned about the average person and their livelihood due to their own products, should either be public or raise their next round in a way that the average person can invest. Otherwise, you're just enriching the billionaires at this point.
English
17
9
184
15.2K
Jeremy Cohen retweetledi
Stat.ML Papers
Stat.ML Papers@StatMLPapers·
There Will Be a Scientific Theory of Deep Learning ift.tt/FIXLaes
English
4
49
317
28K
Jeremy Cohen retweetledi
Jamie Simon
Jamie Simon@learning_mech·
1/ Deep learning is going to have a scientific theory. We can see the pieces starting to come together, and it's looking a lot like physics! We're releasing a paper pulling together these emerging threads and giving them a name: learning mechanics. 🔨 arxiv.org/pdf/2604.21691 🔧
Jamie Simon tweet media
English
53
293
1.5K
301.9K
Jeremy Cohen
Jeremy Cohen@deepcohen·
Looking forward to attending ICLR and giving a talk on Sunday at 9am at the Science of Deep Learning workshop: scienceofdlworkshop.github.io/2026/. Message me if you want to chat about deep learning optimizer dynamics at the conference!
English
3
6
47
4K
Jeremy Cohen
Jeremy Cohen@deepcohen·
@kalomaze found out i needed a visa from this tweet. applied last night, and went to brazil NYC consulate today (on advice of @marikgoldstein), even though the internet says they don't help with this. it worked - the person at the desk approved my visa. YMMV, but hope this helps someone!
English
0
0
3
396
kalomaze
kalomaze@kalomaze·
it is very much so looking like i should have applied for a brazil visa a lot earlier
English
15
1
127
17.4K
Jeremy Cohen retweetledi
Sunny Sanyal
Sunny Sanyal@SunnySanyal9·
I have spent 4 years making LLMs generalize better without more data or compute. I'm looking for a Research role in industry. Here's what I've built: 1/ Early Weight Averaging → First paper (2023) to apply weight averaging during LM pre-training. Now widely used in many pre-training pipelines. arxiv.org/abs/2306.03241 2/ Attention Collapse → Diagnosed attention collapse in LLMs and proposed a training fix.arxiv.org/abs/2404.08634 3/ Curriculum Finetuning → Upweight easy samples and downweight hard ones during finetuning to reduce forgetting. arxiv.org/abs/2502.02797 I am a PhD student at UT Austin. I have interned at DeepMind, LightningAI, and Amazon Alexa. If you're hiring or know someone who is, please DM or email (sanyal.sunny@utexas.edu). Web: sites.google.com/view/sunnysany… #MachineLearning #LLM #NLP #PhD #AIJobs #OpenToWork
GIF
English
3
10
95
21.5K
Jeremy Cohen
Jeremy Cohen@deepcohen·
Isn’t it a little ironic that this argument for why LLMs aren’t truly intelligent is based on … pattern matching?
Big Brain AI@realBigBrainAI

AMI Labs founder Yann LeCun on why LLMs are fooling us the same way AI has for decades: He argues that every generation of AI scientists has made the same mistake: confusing task performance with real intelligence. LeCun's core challenge to the current hype: "We're fooled into thinking those machines are intelligent because they can manipulate language. And we're used to the fact that people who can manipulate language very well are implicitly smart." He's clear that LLMs are useful, but being a useful tool and being intelligent are two very different things. The real insight is the historical pattern he's lived through. Since the 1950s, wave after wave of AI researchers have claimed their breakthrough was the path to human-level intelligence. Marvin Minsky. Herbert Simon. Frank Rosenblatt — who invented the perceptron, the first learning machine, in the 1950s — all predicted machines as smart as humans within a decade. "They were all wrong." LeCun has personally witnessed three of these cycles of hype and disappointment. And his verdict on the current one is blunt: "This generation with LLMs is also wrong. It's just another example of being fooled." The pattern: A new technique emerges → machines get good at specific tasks → we assume general intelligence The question worth asking: are we impressed by these tools because they're intelligent, or because they sound like they are?

English
1
0
14
1.8K
Jeremy Cohen retweetledi
Samip
Samip@industriaalist·
Introducing Q Labs, a research lab focused on solving generalization. Alongside others (SSI, Flapping Airplanes), we see data efficiency as the key problem, but we're taking an unconventional approach to solve it: a new learning algorithm approximating Solomonoff induction.
English
35
54
683
161.5K
Jeremy Cohen retweetledi
Nikhil Ghosh
Nikhil Ghosh@nikhilghosh101·
Sharing our recent work on understanding the mechanisms underlying the empirical success of hyperparameter transfer using μP! (1/11) with Denny Wu and @albertobietti
Nikhil Ghosh tweet media
English
2
33
146
19.4K
Jeremy Cohen
Jeremy Cohen@deepcohen·
@cjmaddison @tylerfarghly I agree that theory will probably never give us a closed form expression for the test error of resnet-50 on ImageNet, or eliminate all hyperpameters from deep learning, if that’s what is meant by “the big things”
English
1
0
2
790
Jeremy Cohen
Jeremy Cohen@deepcohen·
@cjmaddison @tylerfarghly IMO, theory could give us a *language for reasoning* about deep learning. Even with good theory, you’d probably still have to run some experiments, but much fewer than we do now, since you’d learn much more from each one.
English
1
0
10
815
Jeremy Cohen
Jeremy Cohen@deepcohen·
The goal of deep learning theory/science is to guide practice. But most practical questions are >1 paper away from being legitimately answered by theory. How, then, can we make progress, without access to the ideal reward signal of “does this theory give us a SOTA algorithm?” …
English
6
25
182
27.2K
Min Jae Song
Min Jae Song@mj_theory·
@deepcohen Do you have examples of deep learning theory research that satisfy this criterion? If not, what specific directions do you have in mind?
English
1
0
2
187
Jeremy Cohen
Jeremy Cohen@deepcohen·
So, we should focus on theories that can reliably predict “the small things” about deep learning, and gradually broaden the scope of what we can predict, until we have theory that can reliably predict “the big things” about deep learning too.
English
2
5
49
2.8K
Jeremy Cohen
Jeremy Cohen@deepcohen·
A lot of DL theory work gets rightfully criticized for being “postdictive” — always giving an elegant retroactive explanation for SOTA, while somehow never anticipating it. But the real issue isn’t that such theories can’t predict SOTA, it’s that they can’t predict anything.
English
1
2
53
2.6K