TLDR AI · ENGINEERING & RESEARCH

UNSLOTH DYNAMIC 3.0 GGUFS

unsloth.ai12 min read

Summary from the TLDR AI newsletter

Unsloth released Dynamic 3.0 GGUFs, improving accuracy over previous quantization methods while maintaining model size. The update leverages a refined imatrix calibration dataset for better multilingual performance and does not use QAT, reducing overfitting risks. The new version shows up to 10% better top-1% accuracy in smaller quant sizes and substantial disk space savings with improved calibration and quantization techniques.