TLDR AI · RESEARCH & INNOVATION
THUNDER MLA
Summary from the TLDR AI newsletter
The Hazy Research team from Stanford has released a post and code for their ThunderKittens-enabled Multiheaded Latent Attention implementation. It comes out to be 30% or so faster than the official DeepSeek implementation.