A LANGUAGE MODEL WITH QUICK PRE-TRAINING

Summary from the TLDR AI newsletter

The "1.5-Pints" Language Model presents a new approach to compute-efficient pre-training. By curating a high-quality dataset of 57 billion tokens, this model surpasses Apple's OpenELM and Microsoft's Phi in instruction-following tasks, as measured by MT-Bench.