Ricky Ho@rickyho_1989
Everyone is focusing on the soaring memory cost in the Vera Rubin rack. But the real shocker in this Morgan Stanley slide is actually power, because the industry is now talking about moving from roughly 120kW per rack today toward potentially 600kW per rack by the Vera Rubin Ultra generation in 2027, which is an almost unimaginable escalation in power density within an incredibly short period of time.
To put this into perspective, many traditional enterprise datacenters historically operated at only a few kilowatts per rack, while even modern hyperscale campuses today often consume only tens of megawatts in total facility power draw. But once you begin deploying hundreds or thousands of 600kW AI racks simultaneously, the math becomes almost absurd because a large-scale Vera Rubin Ultra cluster could eventually consume gigawatts of electricity, effectively rivaling the energy demand of a mid-sized city.
And this is where the market still massively underestimates the second-order implications of the AI boom, because the bottleneck is no longer simply semiconductors, GPUs, or memory supply. The bottleneck increasingly becomes electricity itself.
The US power grid can barely keep up with current AI infrastructure demand already, while transmission congestion, transformer shortages, substation constraints, cooling limitations, permitting bottlenecks, and aging grid infrastructure are becoming increasingly visible across major datacenter hubs. Importantly, grid infrastructure cannot scale at semiconductor speed. You can accelerate chip production with enough capital expenditure and engineering talent, but building transmission lines, substations, generation capacity, cooling systems, and interconnection approvals often requires many years due to environmental reviews, local opposition, labor shortages, and physical construction constraints.
This is precisely why we continue believing the AI buildout is not a two-to-three-year investment cycle, but instead a decade-long industrial transformation that increasingly resembles the buildout of railroads, electricity networks, and telecom infrastructure during previous industrial revolutions.
And this is also why energy infrastructure is quietly becoming one of the most important and underappreciated AI trades globally.
The winners are no longer just GPU companies. The winners increasingly include utilities like Constellation Energy and Vistra, nuclear-related plays like Oklo and NuScale Power, gas infrastructure companies like Kinder Morgan and Williams Companies, grid and electrical equipment suppliers like GE Vernova, Eaton, Schneider Electric, and Vertiv, as well as transformer, cooling, and datacenter infrastructure providers that now sit directly inside the physical backbone required to support next-generation compute.
Hyperscalers themselves are starting to understand this reality. Companies like Microsoft, Amazon, Alphabet, and Meta are no longer simply software companies buying servers. They are increasingly becoming quasi-energy infrastructure companies because securing long-duration power availability is becoming strategically inseparable from securing compute capacity itself.
That is why nuclear power is quietly returning to the center of the conversation. Hyperscalers may eventually fund or directly partner on nuclear generation projects out of pure necessity because renewable intermittency alone cannot reliably support ultra-high-density AI clusters operating continuously at scale.
In many ways, AI is beginning to collide with physical reality. You cannot run trillion-dollar next-generation compute infrastructure on transmission systems and grid architectures that were largely built decades ago for a completely different industrial era.
The semiconductor story may have started the AI race, but energy infrastructure may ultimately determine who wins it.
