TEACHING SMALL LANGUAGE MODELS TO REASON

Summary from the TLDR AI newsletter

The Orca models are a set of small models from Microsoft that excel at reasoning tasks. There has been concern about validity because much of the information was kept closed. Orca 2 has now been released and the model is available on HuggingFace. It demonstrates good performance for its size, outperforming several larger models on reasoning benchmarks.