XY Han

2.2K posts

XY Han banner
XY Han

XY Han

@XYHan_

Assistant Professor @ChicagoBooth | Most Cited Paper: “Neural Collapse in Deep Net Training” | BSE @Princeton, PhD @Cornell, MS/PostDoc @Stanford

Chicago, IL Katılım Kasım 2011
1.4K Takip Edilen1.7K Takipçiler
XY Han retweetledi
XY Han retweetledi
XY Han
XY Han@XYHan_·
@alexolegimas The cafe in the Hilton in South Loop (next to Grant Park) actually sells deep dish by the slice. Not sure if it’s good, but they do it… 😅
English
1
0
2
484
Alex Imas
Alex Imas@alexolegimas·
Market failure: almost no slice shops sell Chicago deep dish pizza. To get a slice of the good stuff you have to wait for 45 min- 1 hour in a cracked leather booth listening to smooth 80s hits. I mean, it’s always worth it, but still…
Alex Imas tweet media
English
43
1
255
58.5K
XY Han retweetledi
Burny - Effective Curiosity
"When Ronald Graham, a concerned friend and fellow mathematician, bet Erdos $500 that he couldn’t stay off amphetamines for a month, Erdos accepted and easily won the challenge. When the 30 days was up, Erdos said to Graham: “You’ve showed me I’m not an addict. But I didn’t get any work done. I’d get up in the morning and stare at a blank piece of paper. I’d have no ideas, just like an ordinary person.“ “You’ve set mathematics back a month.” Erdos resumed taking amphetamines and did so for every day of his life until his death 17 years later."
XY Han@XYHan_

Imagine if Erdos were still alive with a GPT-5.5 Pro subscription and amped up on amphetamines.

English
4
6
49
4.6K
XY Han retweetledi
Burny - Effective Curiosity
"When Ronald Graham, a concerned friend and fellow mathematician, bet Erdos $500 that he couldn’t stay off amphetamines for a month, Erdos accepted and easily won the challenge. When the 30 days was up, Erdos said to Graham: “You’ve showed me I’m not an addict. But I didn’t get any work done. I’d get up in the morning and stare at a blank piece of paper. I’d have no ideas, just like an ordinary person.“ “You’ve set mathematics back a month.” Erdos resumed taking amphetamines and did so for every day of his life until his death 17 years later." turningpointtreatmentcenter.com/why-are-intell…
English
1
4
42
2.3K
XY Han
XY Han@XYHan_·
Imagine if Erdos were still alive with a GPT-5.5 Pro subscription and amped up on amphetamines.
English
39
77
1.8K
77K
XY Han retweetledi
Ravid Shwartz Ziv
Ravid Shwartz Ziv@ziv_ravid·
My two cents on why information theory doesn't quite work in the real world: as someone who's been arguing with people about IT and its connection to ML since 2016(!), I mostly agree with Alex. (At least) two problems show up when you try to use information theory in ML. First, the distance between theory and reality. Nothing is clean, everything is noisy, full of engineering tricks, and you have to estimate everything. We run experiments with information estimators whose quality we don't really know. But the bigger problem (and I hope Shannon will forgive me): information theory isn't really about learning. In the classical setting you're in an idealized world where everything is given, with no optimization and no learning. There have been attempts to change this (Stefano Ermon's usable information, for one), and many works took inspiration from IT, but actually applying its tools has had limited success. So, next time that people ask you "Does Information theory 'explain AI you can say, "No, and it doesn't supposed..."
Alex Dimakis@AlexGDimakis

x.com/i/article/2057…

English
15
7
66
13.2K
XY Han retweetledi
Ash Jogalekar
Ash Jogalekar@curiouswavefn·
The story goes that apparently Born was too afraid of Oppenheimer to show him the petition directly, but had to entertain it to prevent his classes from being boycotted by Goeppert (better known as Goeppert-Mayer later) and others. So one day he invites Oppenheimer into his office and keeps the petition prominently on his table. He steps out for a few minutes making some excuse. When he comes back Oppenheimer's face is white as a ghost's. After that the interruptions (largely) stop.
1926 Live@100YearsAgoLive

At the University of Göttingen, Germany, one of physicist Max Born’s young students, an American named Robert Oppenheimer, is making quite a ruckus. He completely takes over discussions and will not quiet down. One of his classmates, Maria Goeppert, is circulating a petition wherein signatories are threatening not to come to class unless Oppenheimer shuts up.

English
1
12
206
47.7K
XY Han
XY Han@XYHan_·
In fact, AI replacement fears recently has a lot of parallels with reactions to Wiener's 𝘊𝘺𝘣𝘦𝘳𝘯𝘦𝘵𝘪𝘤𝘴 & Shannon's Info Theory in the 1950s. One optimistic POV is we've been here before. We survived it then; we will survive it now. Again quoting Kline (2015):
XY Han tweet mediaXY Han tweet media
XY Han@XYHan_

Actually, this is not new. People have tried overextending info theory since the 1950's. History is just repeating itself. Some examples from Kline's Cybernetics Moment (2015):

English
0
0
1
157