How Did Elon Musk Build a $7B AI Factory in Memphis Faster Than Microsoft or Meta Ever Could?
Inside Elon Musk’s Colossus: The $7B Compute Factory That Could Redefine the AI Arms Race
Welcome to Global Data Center Hub. Join 1600+ investors, operators, and innovators reading to stay ahead of the latest trends in the data center sector in developed and emerging markets globally.
Elon Musk’s secret weapon in the AI race isn’t just Grok. It’s the factory that makes Grok possible.
xAI did what no one thought was possible: it built a 200,000-GPU supercomputer, Colossus, in just 122 days. That’s ten times faster than anything Microsoft or Meta has delivered. Then, in just 90 more days, xAI doubled capacity to 400,000 GPUs.
And it’s not stopping there. xAI plans to scale Colossus to 1 million GPUs.
Colossus isn’t just a supercomputer. It’s a Gigafactory of Compute, the AI era’s answer to Tesla’s production model.
This piece unpacks:
How xAI built at breakneck speed
Why this model threatens hyperscaler dominance
What it means for the global AI infrastructure race
This is your blueprint to the AI factory of the future.
xAI’s Colossus isn’t just a supercomputer it’s a Gigafactory of Compute, signaling the same industrialized shift we explored in Nvidia’s 100-site AI Factory blueprint.
The Build: From Abandoned Factory to AI Nerve Center
xAI repurposed a 785,000 sq ft Electrolux factory in South Memphis.
It started with just 8MW of power, running on portable diesel generators and Megapacks.
Within 19 days of rack delivery, they were training Grok on 100,000 NVIDIA H100 GPUs.
This kind of velocity isn’t just impressive it’s strategic. Musk knew that if he couldn’t compress time-to-compute, xAI would never catch OpenAI or Anthropic.
Cooling: The Biggest Liquid-Cooled GPU Cluster Ever Built
200,000 GPUs, each burning 700W, needed direct-to-chip liquid cooling.
Supermicro’s 4U Universal GPU racks came pre-plumbed for ultra-dense deployments.
Rear-door heat exchangers made each rack “cooling neutral” to the room.
This wasn’t innovation for innovation’s sake. It was necessity. You can’t run a trillion-token training job in 90°F Memphis heat without world-class cooling.
This wasn’t innovation for its own sake it was survival in 90°F heat, where resilient cooling design has become a critical edge for data center operators.
Power: A Billion-Watt Puzzle
TVA eventually granted 150MW of grid power, with another 150MW planned.
Tesla Megapacks (168 units) stabilized the spikes.
35 gas turbines (later scaled down) filled in during early construction.
Musk even bought a 1 million sq ft facility in Whitehaven, and reportedly an entire overseas power plant to ship to the U.S. for future phases.
Compute is nothing without power. Colossus shows that energy infrastructure is now AI infrastructure.
Networking: Why xAI Ditched InfiniBand
Most hyperscale supercomputers still use InfiniBand.
Colossus runs on NVIDIA’s Spectrum-X Ethernet a bet that might redefine supercomputing.
400Gbps per GPU, plus 400Gbps per CPU server
BlueField-3 SuperNICs for RDMA at scale
95% data throughput efficiency
Why? Open standards, lower costs, and composability for a multi-tenant future.
What It Means for the AI Arms Race
While OpenAI builds Stargate with Oracle and SoftBank, xAI is pursuing vertical integration owning the chips, the power, the racks, and the ground.
The supercomputer is the moat.
And Colossus proves you don’t need 3 years and $20B to build one.
You just need velocity, modularity, and the will to break everything that slows you down.
But Here’s the Catch
That speed came at a cost:
Environmental backlash from gas turbines in Black neighborhoods.
AI safety concerns over Grok’s biases and training data from X.
Regulatory scrutiny over emission permits and water drawdowns.
Still, xAI keeps pushing and the next Colossus may come with its own power plant.
Final Thought
In the AI era, the winner won’t just be the team with the best model.
It will be the team that controls the physical substrate of intelligence: GPUs, electrons, and cooling water.
xAI is building that future. Faster than anyone else.