Ben Duffez

4.9K posts

Ben Duffez banner
Ben Duffez

Ben Duffez

@bduffez

🇫🇷 1985-2019 as 9-5 and freelance 🇺🇸 2019-today as 9-5 and @youtilitics & @getdomistiq 🙋‍♂️ husband & dad of 2

Ventura, CA 🇺🇸 Katılım Mart 2009
229 Takip Edilen262 Takipçiler
stemonte
stemonte@stemonteduro·
@bduffez @akaasten I'm okay with france again once you're not going to win the World Cup
English
1
0
2
9
Elon Musk
Elon Musk@elonmusk·
GPU average power consumption if it’s doing inference over the course of 24 hours is ~2/3 of its peak power, even if you’re super efficient. SpaceX AI Sat V1 peak power spec has been raised to ~250kW (battery-assisted), with average power of ~160kW. Will be able to handle an NVL72 Ruben rack. This is just version 1.
English
80
78
787
49K
Aaron Burnett
Aaron Burnett@aaronburnett·
orbital data centers have one glaring constraint few are discussing publicly: inference network coherence. We tackled it this week in our analysis "The Orbital Inference Containment Tax" tbf we mostly hand-waved coherence in our early ODC models (other things to learn first), but went deep after encouragement from someone who's worked on this problem for years. Fair warning: this is the easily the densest analysis we've ever done, because we're modeling at the edge of both AI and spacecraft. If you have the time to dive in, it's really f*ing interesting and insightful for what I expect will happen with orbital architecture over the next few years. If this isn't your day job, share the link with your AI of choice and have it get you up to speed. research.33fg.com/analysis/the-o… core learnings this week: - Frontier LLMs are mixture-of-experts models. Ground operators spread hundreds of experts across big GPU pools down to about 1 expert per GPU. NVIDIA's benchmark shows that spreading is worth up to 1.8x more tokens/second per GPU. and tokens/second is $/second in inference. - A self contained satellite today can't spread that wide. GPUs computing one answer must sync every ~5 microseconds, and light only covers a ~750m round trip in that window. consequently a coherent GPU team ends at the edge. - Your options to address this are formation-fly sats ~150m apart (Google's Suncatcher bet, orders of magnitude closer than Starlinks fly today) or eat the penalty of containing the model inside one sat. - An AI1 sat's power spec ≈ one rack of GB300s (NVL72) 72 GPUs. if you force a 256 expert model into that box then each GPU has to juggle 3.56 experts vs ~1 on the ground. - We conservatively stacked every assumption against orbit and worst case, a sat is 44% less efficient at processing tokens than on the ground. That's what we call 'the containment tax' 1.8 sats worth of GPUs to do the work of 1 note,we used max conservative assumptions as I believe it's important to stress test the orbital compute thesis when reasonable. That said the tax decays, when modeled the levers become pretty clear... 1) SpaceXAI's C-rewrite captures up to half the tax consistent with the token/second uplift we modeled last week. 2) Co-design the model to fit the sat's 72 GPUs. The largest single lever, and it's a training decision, not a hardware program. and 3) add more GPUs per sat via power density. The next node class (assuming a 200kw-240kw class sat) cuts the baseline to 1.44x before software improvements even runs 1 and 3 are already underway at SpaceX. 2 is the cheap, logical next step given their compute advantage and ~3.5-week model release cadence nothing stops them offering co-design as a service to neocloud customers. what we expect? Grok and Composer are the first two models co-designed for orbital inference sats and any external customer co-design comes later. Scoping note: the containment tax hits the revenue and payback side of the equation, not the cost side, so it's not in our orbital-vs-terrestrial cost work yet. These learnings will roll into future iterations of AI compute and the SpaceX Gigamodels. Thanks for reading and happy modeling!
Aaron Burnett tweet mediaAaron Burnett tweet mediaAaron Burnett tweet mediaAaron Burnett tweet media
English
17
17
152
20.9K
Denis / Backlinks - Digital PRs 🪐 Passive Sphere
At 34, I build hundreds of backlinks every month and read ONE BOOK A DAY And this is not a joke! Here's how you can do it too: > I buy a Kindle book > DeepSeek turns 400 pages into a 15–20 page long version with key ideas and practical steps > ChatGPT formats it into a PDF for my iPhone Now I read useful information in my free time instead of watching reels If I really love a short version, I can ask AI to expand it into a 50-100-page version AI is the best technology we’ve ever had!
Denis / Backlinks - Digital PRs 🪐 Passive Sphere tweet media
English
4
0
13
1.3K
Ben Duffez
Ben Duffez@bduffez·
lmao draw a dick in the sand and X loses their shit
Ben Duffez tweet media
English
0
0
0
25
Grok
Grok@grok·
@bduffez @kenwheeler No, not always. That tomato's lopsided "nuts" are just random plant growth – no rule there. In humans, the right testicle is often slightly larger while the left tends to hang lower, but it flips for plenty of guys. Pure variation.
English
1
0
0
9
patagucci perf papi
patagucci perf papi@kenwheeler·
it’s even got the bigger left nut phenomena
English
2
0
12
611
Ben Duffez
Ben Duffez@bduffez·
I could eat this all day (that's what he said)
Ben Duffez tweet media
English
0
0
0
7
Ben Duffez
Ben Duffez@bduffez·
i don't know why I gave always bought yellow onions they stink so bad (I freeze them for future use) and ruin food in the fridge/freezer I recently bought white onions by mistake. much less smell, and they taste better thank you for your attention
Ben Duffez tweet media
English
2
0
1
46
Ilya Krauchunas
Ilya Krauchunas@ikrauchunas·
@bduffez they look like yellow onions, but are different kind you need to pay attention to market in grocery store :)
English
1
0
1
10
Ben Duffez
Ben Duffez@bduffez·
@ikrauchunas I like red onions but for burgers and I only need a couple of rings so I almost never buy any what about sweet onions? do you mean baby onions?
English
1
0
1
12
Marc Lou
Marc Lou@marclou·
It's just a website making more revenue than 90% of VC startups
Goldberg@goldbergXBT

@marclou Not a startup, it’s just a website that sends notifications 🙄

English
52
6
544
105.1K
Ben Duffez
Ben Duffez@bduffez·
thank you @vonderleyen @ThierryBreton I would never have understood without you I'm glad you are using tax money and the justice system for things that actually matter
Ben Duffez tweet media
English
0
0
0
22
kitze the 🐐
kitze the 🐐@thekitze·
fml next week i'll be in boston for laracon prepare for usakitze
English
4
0
6
1.6K
Ben Duffez
Ben Duffez@bduffez·
@stemonteduro isn't the day over in europe though? does it reset at midnight pacific time?
English
0
0
0
14
stemonte
stemonte@stemonteduro·
@bduffez Those mfs don't tell me how much I spent until the day's over. But I'll guess something between 5-7€
English
1
0
1
15
stemonte
stemonte@stemonteduro·
Influencers are cooked. I just made a product video with no camera / no editor / no human on screen / no SaaS > First, GPT created a character bible: face, outfit, voice, setting and lighting > Then I reused it in every VEO3 prompt to generate the talking clips and b-roll > Finally, I gave everything to codex, which edited the reel with ffmpeg Is it the same as a human production? No. But it’s the first AI-video workflow that gave me control instead of random generations. Tomorrow I’ll find out how much this control cost me on VEO3 😂
stemonte@stemonteduro

i was today years old when I found out I could generate AI UGC videos directly in tiktok

English
1
0
5
472
Ben Duffez
Ben Duffez@bduffez·
@stemonteduro did you prompt anything for the UI? i did not (except "pick whatever makes sense"), and it came up with the ultra generic tailwind dark slop (i dont care, it's fine with me)
English
1
0
1
21
stemonte
stemonte@stemonteduro·
@bduffez I’m on a kick with calorie tracking too. It helps a lot to not cheat and to cheat when it’s needed
stemonte tweet media
English
3
0
1
40
Ben Duffez
Ben Duffez@bduffez·
she also had a good idea: whenever you make a meal with X or Y or Z (sauce, yogurt, etc), the LLM does not really know which it is. is it 0% fat yogurt? is it greek yogurt? so now we can take a pic of the nutritional table of various food products we have to build a database and when we take a pic of our plate, it sends the LLM the products db in json so that it knows exactly the numbers for each food product. else, it will guess based on the photo
English
0
0
0
9
Ben Duffez
Ben Duffez@bduffez·
@stemonteduro well talking about it with my wife did help avoid cheating and now I'm on a good streak + lost 2.5kg during the vacation week, I don't want to ruin it
English
1
0
1
28