TLDR Hardware · GENERAL

THE 1-MEGAWATT RACK DEBATE

semiengineering.com5 min read

Summary from the TLDR Hardware newsletter

The semiconductor and datacenter industries are actively debating the necessity of 1-megawatt server racks driven by continuous, power-intensive AI workloads. While hyperscalers explore ±400V DC power distribution, advanced liquid cooling, and 3D-IC packaging to support ultra-dense compute, critics argue this scaling vector is unsustainable. Instead of cramming accelerators into single dense enclosures to preserve short copper reach, alternative approaches advocate scaling horizontally across racks using optical interconnects and specialized silicon.