TLDR AI · ENGINEERING & RESEARCH
UNSLOTH DYNAMIC 3.0 GGUFS
Summary from the TLDR AI newsletter
Unsloth released Dynamic 3.0 GGUFs, improving accuracy over previous quantization methods while maintaining model size. The update leverages a refined imatrix calibration dataset for better multilingual performance and does not use QAT, reducing overfitting risks. The new version shows up to 10% better top-1% accuracy in smaller quant sizes and substantial disk space savings with improved calibration and quantization techniques.