TCGEN05 FOR DUMMIES

Summary from the TLDR AI newsletter

tcgen05 is the set of PTX instructions that programs Tensor Cores on the latest NVIDIA Blackwell GPUs. This post contains a tutorial for Blackwell in plain CUDA C++ with PTX. It documents the author's process of learning tcgen05 and reaching 98% of CuBLAS speed. Readers can follow the tutorial using Modal or any other B200 cloud providers.