1BIT LLMS

Summary from the TLDR AI newsletter

Most language models use 16 or more bits to represent a parameter in a model. This results in powerful models that can be expensive to run. This work proposes a method that uses 1.58 bits per parameter - each parameter is in {-1, 0, 1}. This method matches performance exactly up to 3B parameters. No code or models have been released yet.