AI FIRMS FOLLOW DEEPSEEK'S LEAD, CREATE CHEAPER MODELS WITH “DISTILLATION”

Summary from the TLDR AI newsletter

Leading AI firms like OpenAI, Microsoft, and Meta are using "distillation" to create more cost-effective models by training smaller systems with a "teacher" LLM.