DIFFERENTIAL TRANSFORMER V2

Summary from the TLDR AI newsletter

DIFF V2 features key upgrades over DIFF V1: faster inference via compatibility with FlashAttention, better training stability by removing per-head RMSNorm, and a simplified λ parameterization that eliminates complex initialization schemes.