TORCHTPU: RUNNING PYTORCH NATIVELY ON TPUS AT GOOGLE SCALE

Summary from the TLDR AI newsletter

Google's Tensor Processing Units (TPUs) are foundational to the company's supercomputing infrastructure. The company's custom ASICs power training and serving for Google and its Cloud customers. TorchTPU is a stack that makes it easy for the AI community to access the full capabilities of TPUs. It provides the APIs and tools needed to extract every ounce of compute from Google's hardware. This post takes a look under the hood at the engineering principles behind TorchTPU.