AUTO GGUF QUANTIZATION (COLAB NOTEBOOK)

Summary from the TLDR AI newsletter

GGUF is a format for running models with llama cpp and supports a number of quantization types. This notebook automates the quantization, which may not work in the general case, but works for most models.