A NOVEL SELF-DISTILLATION METHOD

Summary from the TLDR AI newsletter

Perplexity's JOLT is a self-distillation method that jointly trains a model as both teacher and student, adapting feedback to the student's capabilities. It improved performance and training efficiency across mathematical reasoning, coding, and agentic tasks.