HOW PROMPT CACHING WORKS

Summary from the TLDR AI newsletter

Prompt caching works per-content, not per-conversation. Prefix caching works at the token level, not the request level, which is why it works across requests. Any change in the prefix breaks the entire hash chain.