MINT-1T: SCALING OPEN-SOURCE MULTIMODAL DATA BY 10X

Summary from the TLDR AI newsletter

MINT-1T, a massive open-source multimodal dataset, has been released. Featuring one trillion text tokens and 3.4 billion images, including content from HTML, PDFs, and ArXiv papers, the dataset is about 10 times larger than previous datasets. The resource is aimed at advancing research in large-scale multimodal machine learning.