PYTORCH PER STEP FAULT TOLERANCE

Summary from the TLDR AI newsletter

PyTorch fault tolerance code for gracefully handling training interruptions. Most large established organizations have code of this sort, and to have an open version is quite compelling.