TLDR AI · ENGINEERING & RESOURCES

AXOLOTL INCLUDES QLORA AND FSDP

github.comGitHub repository

Summary from the TLDR AI newsletter

Last week, a breakthrough was made in training large models on small GPUs. This config shows how to use these technologies to train Mixtral on consumer hardware.