Shelly
121 posts

Shelly
@countshelly
engineering driven bottleneck pumping





@ALEXEIMARTOV Tactically, I expect semis to start underperforming for a bit when people think the capex is starting to plateau…that is what is 6-12 months out, but it won’t be the end of the trade. Ppl will chase again as hyperscalers hike capex again. End of trade is 2029-30.


Goldman just put a number on the AI buildout: $7.6T from 2026-2031. They explicitly flag optics as the next “buy out the store” chokepoint after memory. The numbers behind the thesis: +Compute alone is $5.1T of the $7.6T total +Annual AI capex grows from $765B in 2026 to $1.6T in 2031 +Data center cost per MW jumped from $10M (cloud era) to $15-20M (AI era) +A single $50K accelerator depreciates $10K/yr but goes economically obsolete faster than the schedule +NVIDIA’s GB300 NVL72 packs 72 processors per rack, linked by hundreds of thousands of km of cabling In the repot they state: similar episodes of intense, short-term pricing pressure are likely to recur across other critical components such as interconnect, optics, storage, and packaging.” Meaning the same dynamic that just sent memory parabolic is queued up across the entire physical layer of AI infrastructure. The “AI factory of the future” data center will pack 576 GPUs per rack at 500+ kW, requiring liquid-only cooling and millions of GPUs deployed at the >1 GW scale. None of that scales without optics. Memory just ran (still going). Photonics is just warming up. Full disclosure: Goldman is confirming what’s been playing since the late last year. A lot is already priced in. The alpha is front-running institutions, not reading their reports. But $7.6T over 6 years doesn’t get fully priced in 6 months. Plenty of runaway left.

We implemented @karpathy 's MicroGPT fully on FPGA fabric. No GPU. No PyTorch. No CPU inference loop. Just a transformer burned into hardware, generating 50,000+ tokens/sec. The model is small, but the idea is not: inference does not have to live only in software 👇



Many people do not seem to want data centres built near them, despite the fact that they don't cause that much traffic and often generate a lot of local tax revenue. I suspect it's partly because they're ugly! My proposal:




















