TLDR AI · ENGINEERING & RESOURCES

2:4 SPARSE TRAINING IN PYTORCH

pytorch.org16 min read

Summary from the TLDR AI newsletter

The PyTorch team has written custom kernels to make use of sparse cores, which are usually reserved for inference only.