TLDR AI · RESEARCH & INNOVATION

THUNDER MLA

hazyresearch.stanford.edu17 min read

Summary from the TLDR AI newsletter

The Hazy Research team from Stanford has released a post and code for their ThunderKittens-enabled Multiheaded Latent Attention implementation. It comes out to be 30% or so faster than the official DeepSeek implementation.