TLDR AI · RESEARCH & INNOVATION
SCALING LAWS FOR VOCABULARY SIZE
Summary from the TLDR AI newsletter
Larger models need a larger vocab, according to this new research which looks at scaling laws for vocabulary size.
TLDR AI · RESEARCH & INNOVATION
Larger models need a larger vocab, according to this new research which looks at scaling laws for vocabulary size.