KL IS ALL YOU NEED

Summary from the TLDR AI newsletter

KL divergence is a fast, cheap, and powerful way to measure a kind of distance between things. It is used copiously in traditional and modern AI. This post explores the powerful concept visually and mathematically.