100 BILLION IMAGES FOR VLM PRE-TRAINING

Summary from the TLDR AI newsletter

DeepMind scaled vision language model training to a substantially higher data scale than was previously attempted. Western-centric tasks saturate quickly. However, performance on diverse global tasks continues to improve. Interestingly, this improvement is rarely captured by existing benchmarks.