TLDR AI · ENGINEERING & RESOURCES

MAMBA CHAT

github.comGitHub repository

Summary from the TLDR AI newsletter

Mamba is a non-transformer-based model with amazing performance. It has been chat-tuned with SFT and seems to have substantially better out-of-the-box retrieval ability than similarly sized transformers.