GENERALIZED DISCRETE DIFFUSION

Summary from the TLDR AI newsletter

This work extends diffusion on discrete data, such as text, with a generalized denoising process and a slightly improved masking scheme. This combination makes training efficient and gives the model the ability to correct its own output.