NVIDIA TENSOR CORE EVOLUTION: FROM VOLTA TO BLACKWELL

Summary from the TLDR AI newsletter

Tensor Cores—the specialized matrix multiplication units inside modern GPUs—are the core innovation propelling recent AI progress. While Moore's Law has stalled due to physical constraints, NVIDIA has doubled Tensor Core throughput with every generation of GPU ("Huang's Law") by adding ultra-low precision data types and introducing asynchronous execution.