TLDR AI · ENGINEERING & RESOURCES
DO WE REALLY NEED MAMBA FOR VISION
Summary from the TLDR AI newsletter
Mamba is a strong Transformer alternative that has been gaining steam for its ability to use fewer FLOPs while maintaining performance. However, it may not be necessary for some applications. This work shows that a well-tuned CNN baseline outperforms Mamba on a set of vision tasks.