JETMOE - LLAMA 2 PERFORMANCE FOR $100K

Summary from the TLDR AI newsletter

This mixture-of-experts model was trained using public datasets on a reasonable amount of compute. It matches the performance of the much larger and more expensive Llama 2 7B model from Meta.