MASKED AUDIO GENERATION WITH A SINGLE NON-AUTOREGRESSIVE TRANSFORMER

Summary from the TLDR AI newsletter

Most audio generation techniques use diffusion or an auto-regressive model to generate sounds. This research doesn't use multi-steps or a complicated Transformer. Instead, it uses a masked language model over audio tokens.