STRIPEDHYENA 7B MODEL

Summary from the TLDR AI newsletter

Transformer models have dominated the AI landscape recently. They are powerful sequence learners but have some drawbacks. This new work, which builds on state space models, shows that new architectures can bring great benefits like increased context length.