TLDR DevOps · QUICK LINKS

PROMPT CACHING IS GA ON DIGITALOCEAN SERVERLESS INFERENCE: UP TO 90% OFF THE CONTEXT YOUR AGENTS RESEND

digitalocean.com6 min read

Summary from the TLDR DevOps newsletter

Prompt caching is now generally available on DigitalOcean Serverless Inference.