TLDR AI · ENGINEERING & RESOURCES
SPEEDING UP DIFFUSION MODELS WITH ASYNCDIFF
Summary from the TLDR AI newsletter
AsyncDiff is a new acceleration scheme that enables parallel computation in diffusion models. It significantly reduces latency without compromising quality by dividing the noise prediction model into multiple components and running them on separate devices.