NEW SEQUENCE MIXERS

Summary from the TLDR AI newsletter

The creators of Mamba (and many more models) have released a cool blog post outlining basic sequence mixing architectures that give pretty dramatic speed ups relative to standard Transformers.