THE PARADOX OF DIFFUSION DISTILLATION

Summary from the TLDR AI newsletter

Diffusion models break down hard problems, like image generation, into many smaller problems, like removing a tiny amount of noise from an image. A lot of effort has been put into single step diffusion generation, which seems to defeat the point. This post explores the paradox of diffusion distillation and outlines the many research directions available.