TLDR AI · MISCELLANEOUS

IS AI EATING ALL THE ENERGY?

blog.giovanh.com28 min read

Summary from the TLDR AI newsletter

AI's energy consumption is positively correlated with power usage, heat, carbon, and water use, with both increasing demand and improving energy efficiency influencing the overall energy footprint of AI. AI processing is generally becoming more power-hungry, and efficiency gains in hardware are helping to mitigate this trend. Still, AI represents a growing yet still minor segment of data center power usage, with training operations consuming significantly more energy than inference, though widespread use dilutes this impact.