TLDR AI · DEEP DIVES & ANALYSIS

NEXT-TOKEN PREDICTOR IS AN AI'S JOB, NOT ITS SPECIES

astralcodexten.com14 min read

Summary from the TLDR AI newsletter

Overemphasizing next-token prediction is a confusion of levels. On the levels where AI is a next-token predictor, humans are also next-token predictors. On the levels where humans are not next-token predictors, AI isn't one either. While AI was shaped by next-token prediction, the inside of its thoughts probably looks like a world-model, the same as a human's.