FLASH ATTENTION REIMAGINED WITH KVAX

Summary from the TLDR AI newsletter

Nebius open-sourced Kvax: a JAX-based Flash Attention implementation optimized for long-context training. Achieve faster, denser packing and state-of-the-art performance with context parallelism and efficient doc mask computation [12]—built by Nebius' AI R&D team.