TOUCHING THE ELEPHANT - TPUS

Summary from the TLDR AI newsletter

The development of Google's Tensor Processing Unit (TPU) is a story of trade-offs, constraints, and co-design. It involved working with hardware, software, algorithms, systems, network topology, and everything in between. TPUs did not happen by accident, but through the deliberate process of design and iteration. This article tells the story of how Google created a chip designed with deep learning in mind.