Robert Weber retweetledi

AMP PBC Founder @AnjneyMidha says the massive amount of AI compute being wasted in the U.S. is a national security crisis:
“Every dollar of long-term lease that an AI lab takes today, you lose about 30–40% of FLOPs in just bad scheduling. The nodes are just straight-up not allocated.”
“Then within the chip, you only have like 15% of the chip being utilized. That’s called MFU, model FLOP utilization, because the chip is waiting around for some other process to complete: storage, memory, networking, or some other chip to hand it off.”
“If you compound those two things, of every dollar, only 15% of FLOPs are actually being utilized. That 85%? That’s a national security crisis, because that’s what’s keeping us from staying at the frontier.”
“Am I building up more supply? But also, are we utilizing the existing capacity to get the maximum output possible? Both those things are what’s going to keep us at the frontier.”
English
















