As we and the remainder of the tech media have documented, AI is a useful resource hog. AI electrical energy consumption may account for as much as 12 % of all U.S. energy by 2028. Generative AI queries consumed 15 terawatt-hours in 2025 and are projected to devour 347 TWh by 2030. Water consumption for cooling AI information facilities is predicted to double and even quadruple by 2028 in comparison with 2023.
However Moore’s reporting shines a light-weight on an obscure nook of the AI increase. HBM is a selected kind of reminiscence product tailored to serve AI processors. Makers of these processors, notably Nvidia and AMD, are demanding increasingly more reminiscence for every of their chips, pushed by the wants and needs of corporations like Google, Microsoft, OpenAI, and Anthropic, that are underwriting an unprecedented buildout of knowledge facilities. And a few of these amenities are colossal: You possibly can learn concerning the engineering challenges of constructing Meta’s mind-boggling 5-gigawatt Hyperion website in Louisiana, in “What Will It Take to Construct the World’s Largest Information Heart?”
We realized that Moore’s HBM story was each vital and distinctive, and so we determined to incorporate it on this concern, with some updates because the authentic printed on 10 February. We paired it with a latest story by Contributing Editor Matthew S. Smith exploring how the memory-chip scarcity is driving up the value of low-cost computer systems just like the Raspberry Pi. The result’s “AI Is a Reminiscence Hog.”
The large query now’s, When will the scarcity finish? Value strain brought on by AI hyperscaler demand on all types of shopper electronics is being masked by cussed inflation mixed with a perpetually shifting tariff regime, a minimum of right here in america. So I requested Moore what indicators he’s in search of that will sign an easing of the reminiscence scarcity.
“On the availability facet, I’d say that if any of the massive three HBM corporations—Micron, Samsung, and SK Hynix—say that they’re adjusting the schedule of the arrival of recent manufacturing, that’d be an vital sign,” Moore advised me. “On the demand facet, it will likely be attention-grabbing to see how tech corporations adapt up and down the availability chain. Information facilities would possibly steer towards {hardware} that sacrifices some efficiency for much less reminiscence. Startups creating all types of merchandise would possibly pivot towards artistic redesigns that use much less reminiscence. Constraints like shortages can result in attention-grabbing expertise options, so I’m trying ahead to overlaying these.”
To make certain you don’t miss any of Moore’s evaluation of this subject and to remain present on the whole spectrum of expertise growth, join our weekly publication, Tech Alert.
From Your Web site Articles
Associated Articles Across the Net
Leave a Reply