WHAT HAPPENS WHEN WE CAN'T JUST BUILD BIGGER AI DATACENTERS ANYMORE?

Summary from the TLDR newsletter

AI's continued growth may ultimately hinge on a new kind of supercomputer that spans entire countries. This will involve stitching together existing datacenters to distribute the workload. The infrastructure required to stitch datacenters together already exists, but it is tuned more for disaster recovery and high-availability than large-scale AI training. Research is already underway to improve the technology, which will help address power challenges by allowing datacenters in different regions to work as one.