HOW WE’LL REACH A 1 TRILLION TRANSISTOR GPU

Summary from the TLDR newsletter

Recent achievements in AI have been due to three factors: innovation in efficient machine-learning algorithms, the availability of massive amounts of data to train neural networks, and progress in energy-efficient computing through the advancement of semiconductor technology. The industry will need much more powerful devices to continue at its current pace. For the past 50 years, the industry has focused on shrinking the transistor, but now, there are many more possibilities. Future GPUs will not be restricted to the sizes and form factors of current devices - integrated AI systems will be composed of as many energy-efficient transistors as is practical.