TLDR AI · ENGINEERING & RESEARCH

MINISTRAL 3 TECHNICAL REPORT

arxiv.org18 min read

Summary from the TLDR AI newsletter

Ministral 3 is a new family of dense language models (3B, 8B, and 14B) optimized for low-resource environments, offering base, instruction-tuned, and reasoning variants. The models support image understanding and were trained using Cascade Distillation, an iterative distillation and pruning method.