Jamie Simon

130 posts

Jamie Simon

Jamie Simon

@learning_mech

doing fundamental science of deep learning | PhD from Berkeley | can catch a whole egg in my mouth

Berkeley, CA Katılım Aralık 2023
74 Takip Edilen1.3K Takipçiler
Jamie Simon
Jamie Simon@learning_mech·
did you know that with a few modifications, you can get the Ising model to simulate cells fighting to the death? one of my favorite side projects of all time: jamiesimon.io/blog/cell-figh…
English
9
51
342
28.3K
Jamie Simon
Jamie Simon@learning_mech·
@guzmansalv me too. my favorite method is having an immune system!
English
0
0
2
196
Jamie Simon
Jamie Simon@learning_mech·
for the bright-eyed and bushy-tailed: there's a Learning Mechanics discord! young academics who want to do research in this area should especially consider joining + starting convos. discord.gg/GTHfUnf7hz
English
0
2
27
2K
Jamie Simon retweetledi
Good Work
Good Work@goodworkmb·
Palantir office speedrun
English
203
2.4K
36.3K
2.4M
Jamie Simon
Jamie Simon@learning_mech·
ditto. props to @justanotherlaw for taking a second look :) (though I also found merit in the criticisms in the first version.) hopeful we can eventually (hopefully soon enough...) make contact w/ AI alignment + governance, whose noble causes we would v much like to aid.
Alex Atanasov@ABAtanasov

This is a great post and I especially respect the author for updating his view when presented with new information. I strongly encourage young researchers interested in interpretability, science of DL, and safety to look at it. lesswrong.com/posts/6SRq7mZ9…

English
0
0
9
1.2K
Jamie Simon retweetledi
Jamie Simon retweetledi
Tim Duignan
Tim Duignan@TimothyDuignan·
Aren’t diffusion models explicitly derived from a correspondence with physics and entirely consistent with how physics says you should model systems over a range of scales ( ie mori zwanzig theory: langevin dynamics with a fitted vector field ? ) what more do you want?
Pedro Domingos@pmddomingos

Sorry, but these correspondences between AI and physics are vacuous. People have been making them since (at least) the 80s, and they always come to nothing.

English
6
3
95
17.6K
Jamie Simon
Jamie Simon@learning_mech·
@aniketdxsh haha I literally have this xkcd in my head whenever I talk about this tendency
English
0
0
1
29
Jamie Simon
Jamie Simon@learning_mech·
@evergreencqfu smth like that seems plausible! (the challenge is to make it concrete.) would love to see that developed. u should comment on the open Q page and/or join our discord + see if u can find ppl to discuss with!
English
1
0
3
38
Jamie Simon
Jamie Simon@learning_mech·
1/ Deep learning is going to have a scientific theory. We can see the pieces starting to come together, and it's looking a lot like physics! We're releasing a paper pulling together these emerging threads and giving them a name: learning mechanics. 🔨 arxiv.org/pdf/2604.21691 🔧
Jamie Simon tweet media
English
52
288
1.5K
287.7K
Jamie Simon
Jamie Simon@learning_mech·
those things (FT, replicas, etc) are v useful tools - but the answer won't be like, "ah! deep learning was just X thing from physics all along!" would be nice, but not the world we live in. so physics is an analogy and a tool, not "the answer via a correspondence" or smth :)
English
1
0
6
575
Jamie Simon retweetledi
Sebastien Bubeck
Sebastien Bubeck@SebastienBubeck·
From "Mathematical theory of deep learning: Can we do it? Should we do it?" to "There Will Be a Scientific Theory of Deep Learning". It's respectively the title of a talk I gave four years ago, and the title of an arxiv paper from four days ago. I really like the "learning mechanics" perspective (think of it as a continuation of "statistical mechanics", "quantum mechanics", and so on). Several of my last academic papers can be viewed under that lens (e.g. Learning threshold neurons via the “edge of stability”; or LEGO). I'm not as optimistic as the authors of the recent arxiv paper that we will EVER be able to reach what the "physics mechanics" field have achieved, but it's certainly worth trying. Talk: youtu.be/3uRD_lg701k?si… Paper: arxiv.org/abs/2604.21691
YouTube video
YouTube
English
17
61
424
51.6K