INTRODUCING TERNARY BONSAI: TOP INTELLIGENCE AT 1.58 BITS

Summary from the TLDR AI newsletter

Ternary Bonsai is a 1.58-bit language model family offering improved performance with minimal memory usage. It outperforms 1-bit counterparts, scoring 75.5 on average benchmarks and achieving 3-4x better energy efficiency. The models, available in 8B, 4B, and 1.7B versions, provide flexible deployment across devices like Macs and iPhones under the Apache 2.0 License.