LOW-BIT QUANTIZATION WITH PARETOQ

Summary from the TLDR AI newsletter

ParetoQ is a new training algorithm that unifies binary, ternary, and 2-to-4 bit quantization, achieving state-of-the-art results across all levels.