TLDR AI · RESEARCH & INNOVATION
PILE-T5
Summary from the TLDR AI newsletter
T5 is a workhorse of modern AI. Eleuther has retrained it with a modern tokenizer and for much longer. The result is a greatly improved base model for encoding tasks.
TLDR AI · RESEARCH & INNOVATION
T5 is a workhorse of modern AI. Eleuther has retrained it with a modern tokenizer and for much longer. The result is a greatly improved base model for encoding tasks.