NVIDIA AND MIT RESEARCHERS IMPROVE HOW HARDWARE HANDLES SPARSITY

Summary from the TLDR AI newsletter

Sparse tensors occur when some values of the neural network are zeros. These values can efficiently be skipped. Researchers developed a way to quickly find when values are zero and overload hardware to fit more non-zero values onto a chip at a time.