TLDR AI · MISCELLANEOUS
WHAT HAPPENED TO BERT?
Summary from the TLDR AI newsletter
Great post by Yi Tay of Reka and Google on encoders, prefixlm, denoising objectives, and more modern tricks for language modeling.
TLDR AI · MISCELLANEOUS
Great post by Yi Tay of Reka and Google on encoders, prefixlm, denoising objectives, and more modern tricks for language modeling.