Mo Bavarian

1.1K posts

Mo Bavarian

Mo Bavarian

@mobav0

Scaling up RL at OpenAI 🍓 Optimization and long context research before. Math PhD, MIT.

San Francisco, CA Katılım Ekim 2016
1K Takip Edilen17.4K Takipçiler
Mo Bavarian retweetledi
Dwarkesh Patel
Dwarkesh Patel@dwarkesh_sp·
New blackboard lecture w @reinerpope How do chips actually work – starting with basic logic gates, and working up to why GPUs, TPUs, FPGAs, and the human brain each look the way they do. 0:00:00 – Building a multiply-accumulate from logic gates 0:16:20 – Muxes and the cost of data movement 0:25:59 – How systolic arrays work 0:39:00 – Clock cycles and pipeline registers 0:51:40 – FPGAs vs ASICs 1:03:14 – Cache vs scratchpad 1:07:16 – Why CPU cores are much bigger than GPU cores 1:11:49 – Brains vs chips 1:15:22 – A GPU is just a bunch of tiny TPUs Look up Dwarkesh Podcast on YouTube/Spotify/etc to watch. Enjoy!
English
94
717
5.5K
902K
Mo Bavarian retweetledi
Timothy Gowers @wtgowers
Timothy Gowers @wtgowers@wtgowers·
AI has now solved a major open problem -- one of the best known Erdos problems called the unit distance problem, one of Erdos's favourite questions and one that many mathematicians had tried. openai.com/index/model-di…
English
72
606
3.5K
1.5M
Mo Bavarian retweetledi
Dylan Patel
Dylan Patel@dylan522p·
Banger take
Patrick OShaughnessy@patrick_oshag

Gavin Baker: "I've been optimistic that the fundamental shortage of wafers, which is really controlled by Taiwan Semi, will prevent a bubble." "If Taiwan Semi did what Jensen wanted, Nvidia could sell $2 trillion of GPUs in 2026 or 2027. But there is a limit where consumers would consume so much that you'd probably be in an overbuild. And you are starting to see companies go to Intel and Samsung. A lot of this may come down to the degree to which Taiwan Semi can maintain a lead over Intel and Samsung and the pace at which they expand capacity. If I were to watch one thing to understand whether there's a bubble, it's Taiwan Semi's capacity decisions. There's a Goldilocks zone where they expand enough to make it hard for Intel or Samsung to emerge as a second source, but they also keep the fundamental constraint on wafers that helps us avoid a bubble."

San Francisco, CA 🇺🇸 English
31
37
825
165K
Mo Bavarian
Mo Bavarian@mobav0·
Stop living in a bubble. The key to happiness, the true meaning of life, is not impact or wealth or fame, but health, friendship, and care for others. Living authentically is not that expensive. In other words, money or success will not fill the hole in your heart.
Amadeo Pellicce@amapel

x.com/i/article/2056…

English
3
5
102
34.4K
Mo Bavarian retweetledi
Bilal Zuberi
Bilal Zuberi@bznotes·
I remind myself of this quite often.
Bilal Zuberi tweet media
English
85
456
6K
750.2K
Mo Bavarian
Mo Bavarian@mobav0·
Stochastic gradient descent
Mo Bavarian tweet media
English
9
33
422
19.3K
Mo Bavarian
Mo Bavarian@mobav0·
@xanderai Tbc, I have no beef with peptides. May they all triumph in RCAs and become smashing successes like GLP1’s. But until the RCAs, the grifters are gonna grift
English
0
0
2
185
Xander Dunn
Xander Dunn@xanderai·
@mobav0 AI will exit its grifter phase when it makes a scientific discovery on the level of GLP1 peptides.
English
1
0
3
312
Mo Bavarian
Mo Bavarian@mobav0·
One of the biggest benefits of peptides is that it has distracted a decent fraction of grifters (ever-present in SF tech scene) away from AI. God bless 🙏
English
3
1
84
6.4K
Mo Bavarian
Mo Bavarian@mobav0·
San Francisco— the birthplace of AGI
English
4
1
39
2.5K
Mo Bavarian
Mo Bavarian@mobav0·
It was fun doing this panel with my friends @dwarkesh_sp @_sholtodouglas and Melvin Johnson, and thanks @labelbox for hosting. It's the first time for me facing the ever-spicy Dwarkesh questions in front of an audience. It's v important for frontier lab researchers to stay connected. Less adversity, more comradeship & cooler heads is necessary as the stakes for this technology gets higher.
Labelbox@labelbox

This week, we had the pleasure of hosting 50+ researchers and builders from leading AI companies to meet, talk and socialize (MTS 😎) at Labelbox HQ. Huge thanks to @dwarkesh_sp, Sholto Douglas (Anthropic), Mo Bavarian (OpenAI), and Melvin Johnson (DeepMind) for leading our fireside chat on scaling RL and the pursuit of AGI.

English
1
3
53
14.9K
Mo Bavarian retweetledi
Valentin Ignatev
Valentin Ignatev@valigo·
JRR Tolkien used genz brainrot slang over 70 years ago, that's how ahead he was
Valentin Ignatev tweet media
English
139
1.7K
22.1K
1.1M
Mo Bavarian
Mo Bavarian@mobav0·
Good cooking by a cracked team 🧑‍🍳
ComfyUI@ComfyUI

Two massive updates for the ComfyUI ecosystem today: 1️⃣ App Mode: The power of the node graph, now behind an easy-to-use interface. Turn complex workflows into custom apps. 2️⃣ ComfyHub: A brand new home to discover, run, and share community workflows and apps instantly via URL. Try ComfyHub preview via links.comfy.org/4dke0ki Create in App Mode. Share on ComfyHub. Learn more here: links.comfy.org/4bAOjuz

English
0
0
4
1.6K
Mo Bavarian retweetledi
Dean W. Ball
Dean W. Ball@deanwball·
I do not share the cynicism of some with respect to OpenAI’s actions in the DoW/Ant dispute. It basically seems to me as though OpenAI was attempting to deescalate last week; whether they executed well is a separate question, but in their defense good execution in such chaos was nearly impossible. But from where I sit it seems OpenAI tried to reduce tensions and find a productive path forward, while allowing its employees considerable latitude to speak their minds. The easy thing would have been for management to stay quiet and let this happen; they did not do that, and they also stood firm in opposition to the supply-chain risk designation. In general, OpenAI is unjustly maligned. This is the thing that bothers me the most about Dario’s leaked memo; it spends so much time on OpenAI conspiracies and cynicism that I fear industry solidarity in the future will be harder than it needs to be. This is not the last time we will see state interference into frontier AI, and until we build formalized structures for such interference it will be important for the industry to hang tough together. I fear that will be less likely now.
English
39
40
518
42.5K
Mo Bavarian
Mo Bavarian@mobav0·
As an American working in frontier for the last 5 years (at Anthropic’s biggest rival, OpenAI), it pains me to see the current unnecessary drama between Admin & Anthropic. I really hope the Admin realies its mistake and reverses course. USA needs Anthropic and vice versa! 🇺🇸
English
2
2
78
3.8K
Mo Bavarian
Mo Bavarian@mobav0·
I don’t think there is an un-crossable gap between what Anthropic wants and DoW’s demands. With cooler heads it should be possible to cross the divide. Even if divide is un-crossable, off-boarding from Anthropic models seems like the right solution for USG. The solution is not designating a great American company by the SCR label, which is reserved for the enemies of the US and comes with crippling business implications.
English
2
2
57
5K
Mo Bavarian
Mo Bavarian@mobav0·
Anthropic SCR designation is unfair, unwise, and an extreme overreaction. Anthropic is filled with brilliant hard-working well-intentioned people who truly care about Western civilization & democratic nations success in frontier AI. They are real patriots. Designating an organization which has contributed so much to pushing AI forward and with so much integrity does not serve the country or humanity well.
English
13
32
406
36.2K
Amanda Askell
Amanda Askell@AmandaAskell·
@elonmusk I'm hoping we can break the curse. The alternative is picking a name like EvilAI, which seems like a hard sell.
English
73
7
993
66.9K
Amanda Askell
Amanda Askell@AmandaAskell·
Claude's constitution is out! It's the culmination of a lot of work by many people, but it's also a work in progress that will no doubt change and hopefully improve over time. I'm looking forward to people's thoughts, and to talking with more people about this kind of work ❤️
Anthropic@AnthropicAI

We’re publishing a new constitution for Claude. The constitution is a detailed description of our vision for Claude’s behavior and values. It’s written primarily for Claude, and used directly in our training process. anthropic.com/news/claude-ne…

English
256
179
2.9K
809.7K

Keşfet

@reinerpope @xanderai @dwarkesh_sp @_sholtodouglas @labelbox @AmandaAskell @elonmusk @BarackObama