MINBPE

Summary from the TLDR AI newsletter

Andrej Karpathy released a minimal, clean, and extensible implementation of the byte pair encoding used in language model tokenizers.