MOONLIGHT 16B MUON TRAINED MODEL

Summary from the TLDR AI newsletter

This is the first (public) large scale model trained with the Muon optimizer. It was trained for 5.7T tokens and is a very similar architecture to DeepSeek v3.