TLDR AI · ENGINEERING & RESOURCES
AXOLOTL INCLUDES QLORA AND FSDP
Summary from the TLDR AI newsletter
Last week, a breakthrough was made in training large models on small GPUs. This config shows how to use these technologies to train Mixtral on consumer hardware.