INSIDE PROMETHEUS: META'S JOURNEY TO A GIGAWATT-SCALE SUPERCLUSTER

Summary from the TLDR DevOps newsletter

Meta is building Prometheus, a gigawatt-scale supercluster in New Albany, Ohio, that will eventually comprise roughly 1 million GPUs. The first phase of the project has already trained the company's Muse foundational models. Meta achieved over 85% goodput for pre-training runs and reduced interruption rates by 99% from their peak. The cluster currently deploys NVIDIA GB200 and GB300 platforms, with plans to integrate the upcoming Vera Rubin NVL72 next.