TLDR AI · MISCELLANEOUS

SAE INTUITIONS

adamkarvonen.github.io18 min read

Summary from the TLDR AI newsletter

Sparse Autoencoders are the number one tool used today to understand the internals of language models. This post explores the intuitions behind the models and some good information on how they work.