TLDR AI · RESEARCH & INNOVATION
TWO TRILLION TOKEN COMMON CORPUS
Summary from the TLDR AI newsletter
This release marks the largest open and permissively licensed dataset for language model training. It has substantial multilingual representation.
TLDR AI · RESEARCH & INNOVATION
This release marks the largest open and permissively licensed dataset for language model training. It has substantial multilingual representation.