MINIMAX TEASES UPCOMING M3 MODEL WITH NEW SPARSE ATTENTION MECHANISM AND 15.6X LONG-CONTEXT RESPONSE SPEED BOOST

Summary from the TLDR AI newsletter

MiniMax has released a new in-depth technical report on the making of its popular M2 series of language models. The report sheds light on numerous engineering innovations and clever approaches. It teases a new sparse attention approach used in MiniMax's upcoming series of models that yields up to 15.6 times faster decode speed at long contexts. MiniMax's upcoming M3 models will make ultra-long-context AI agent deployment economically viable.