TLDR AI · ENGINEERING & RESEARCH

TRICKS FROM OPENAI GPT-OSS YOU 🫵 CAN USE WITH TRANSFORMERS

huggingface.co23 min read

Summary from the TLDR AI newsletter

OpenAI's recently released GPT-OSS series of models features novel techniques like MXFP4 quantization, efficient kernels, a brand-new chat format, and more. The library has been upgraded considerably. This post looks at all of the upgrades in-depth. The updates make it very efficient to load, run, and fine-tune the models.