TLDR AI · ENGINEERING & RESOURCES
SAMBA: A SIMPLE MAMBA
Summary from the TLDR AI newsletter
Microsoft has trained a Mamba-based model on the Phi 3 dataset. It dramatically outperforms the transformer variant on MMLU, HumanEval, and retrieval.
TLDR AI · ENGINEERING & RESOURCES
Microsoft has trained a Mamba-based model on the Phi 3 dataset. It dramatically outperforms the transformer variant on MMLU, HumanEval, and retrieval.