AN EMPIRICAL STUDY OF AUTOREGRESSIVE PRE-TRAINING FROM VIDEOS

Summary from the TLDR AI newsletter

Great paper from the same authors as the above GMAE paper. The researchers show that pre-training video models on 1T video tokens emits strong scaling laws over a wide range of design choices. Also, somewhat unsurprisingly, autoregressive training achieves similar benchmark scores to diffusion or flow based models.