ANNOUNCING PIXTRAL 12B

Summary from the TLDR AI newsletter

Pixtral 12B excels in multimodal tasks, maintaining state-of-the-art performance on text-only benchmarks, and supports variable image sizes in a 128K token context window. Its architecture includes a new 400M parameter vision encoder and a 12B parameter multimodal decoder based on Mistral Nemo. Pixtral outperforms many open and closed models in multimodal reasoning and instruction following without compromising on text capabilities.