EVERYTHING WE KNOW ABOUT MUON OPTIMIZER

Summary from the TLDR AI newsletter

One of the NanoGPT speed run record holders has written an in depth blog post about the newest Muon optimizer that is used in many of the winner runs.