TLDR Dev · MISCELLANEOUS
YOUR CODING AGENT LOSES ITS CACHE WHILE IT WAITS FOR YOU
Summary from the TLDR Dev newsletter
A survey of agent inference research distinguishes cache misses caused by memory pressure from those caused by human pauses. One public trace reported about 97% cache reuse after tool calls but 18% after gaps longer than an hour, highlighting a retention problem that autonomous benchmark loops often miss.