DEEPDIVE: MAMBA THE HARD WAY

Summary from the TLDR AI newsletter

Sasha Rush has released an annotated tutorial for accelerating Mamba with custom Triton kernels. It doesn’t scale yet due to a bug in the Triton compiler, but it is an extreme illustration of the technology and great for those looking to dive deeper into the state space Transformer alternative world.