TROUBLESHOOTING PYTORCH MEMORY ISSUES

Summary from the TLDR AI newsletter

One of the biggest challenges for practitioners using Pytorch has been figuring out why things run out of memory. Some amazing new tools in Pytorch 2.1 give insight into memory usage. It can even be used to classify the usage into familiar buckets (e.g., activations, gradients).