NON-LLAMA LANGUAGE MODEL THAT’S PRETTY GREAT

Summary from the TLDR AI newsletter

Finding a model not built on the foundation model from Meta is a challenge these days. Palmyra from Writer was trained on 800B tokens and 70k highly curated instructions. It excels at following complex instructions and seems amenable to fine-tuning.