DIGITALOCEAN INFERENCE ROUTER, NOW CACHE-AWARE: WHY THE CHEAPEST MODEL ISN'T ALWAYS THE BEST DEAL

Summary from the TLDR DevOps newsletter

DigitalOcean has added cache-aware routing to its Inference Router, letting the system account for the cost of breaking a warm prompt cache when deciding whether to switch models mid-session. The update pairs with two new controls: an explicit model affinity header that ties requests to a session, and a routing budget parameter that caps how much extra cost a model switch can incur.