TEMPORALLY-CORRELATED NOISE PRIOR FOR DIFFUSION MODELS

Summary from the TLDR AI newsletter

Diffusion model noise sampling works well for single images, but struggles when scaled up to videos that require temporal consistency. As the noise itself is independent across pixels and frames, you see a number of warping artifacts. This work aims to introduce integral noise which accounts for many of these problems.