TLDR AI · ENGINEERING & RESEARCH
CONTEXT MANAGEMENT IN AMP
Summary from the TLDR AI newsletter
The context window is the entire input that a large language model receives when generating output. It contains messages, the model's replies, tool calls, and the thinking blocks the model outputs to 'reason'. Everything that happens between the user and the model goes into the context window. This article walks users through some of the ways Amp gives users to manage the contents in a context window.