FASTER MOE TRAINING WITH CUSTOM CUDA KERNELS

Summary from the TLDR AI newsletter

Cursor rebuilt the Mixture-of-Experts layer from scratch using CUDA and PTX, achieving a 3.5x speedup in MoE operations. This resulted in a 1.5x end-to-end training speedup on Blackwell GPUs compared to Hopper.