QLORA 65B PARAMETER MODELS FINE-TUNED ON 48GB GPU

Summary from the TLDR AI newsletter

LoRA is a way to fine-tune models much more cheaply than full fine-tuning. It works by just updating a small, carefully selected, subset of the model. However, even then it is often too expensive to fine-tune large (more than 13B parameter) models on commodity hardware. Quantization reduces the precision of parameters in the model which in turn takes less space. More great open source progress.