INTRODUCING FLASHPACK: LIGHTNING-FAST MODEL LOADING FOR PYTORCH

Summary from the TLDR AI newsletter

FlashPack is a high-throughput file format and loading mechanism for PyTorch that makes model checkpoint I/O blazingly fast. It can load any model 3–6× faster than with the current state-of-the-art methods. FlashPack is wrapped in a lightweight, pure-Python package that works anywhere. It even works on systems without access to GPU Direct Storage.