TLDR Dev · MISCELLANEOUS

CROSS-REQUEST KV CACHE EXPOSURE IN WORKERS AI

blog.cloudflare.com16 min read

Summary from the TLDR Dev newsletter

Cloudflare reports that 155 GLM-5.3 responses exposed data from other customers after oversized prompts encountered a KV cache capacity mismatch and an SGLang error-handling bug. The model was restored in September after remediation, and the October disclosure explains how a rejected request could still decode against stale cache pages.