ANNOUNCING BONSAI 27B: THE FIRST 27B-CLASS MODEL TO RUN ON A PHONE

Summary from the TLDR AI newsletter

PrismML announced Bonsai 27B, the first 27B-class model running on a phone, achieved through 1-bit and ternary weights, shrinking the model size to 3.9 GB and 5.9 GB respectively. Bonsai 27B supports complex tasks like multi-step reasoning and tool use while maintaining high performance, fitting securely within the device limits of modern smartphones.