DIFFUSION IS SPECTRAL AUTOREGRESSION

Summary from the TLDR AI newsletter

Diffusion models and autoregressive models are fundamentally similar, both using iterative refinement processes. Using Fourier transform techniques, this author shows how diffusion models operate like approximate autoregression in the frequency domain, particularly for visual data. This insight highlights potential directions for unifying generative modeling approaches across different data types.