NANOT5

Summary from the TLDR AI newsletter

We’ve covered this in previous newsletters, but it just got an upgrade. Inspired by Andrej’s great NanoGPT repo, the NanoT5 repo can train a model to equivalent T5 paper performance 150x faster. It’s definitely worth checking out if you care about training models from scratch.