BEYOND SELF-ATTENTION: HOW A SMALL LANGUAGE MODEL PREDICTS THE NEXT TOKEN

Summary from the TLDR Web Dev newsletter

A comprehensive walkthrough with code examples on how a small language model works and how it predicts tokens.