TLDR DevOps · OPINIONS & TUTORIALS

WHEN THE KUBERNETES API WENT SILENT: A THREE-LAYER NETWORKING MYSTERY

cloud.google.com8 min read

Summary from the TLDR DevOps newsletter

Google traced intermittent GKE API timeouts to three interacting failures: Private Service Connect reordered packets, Envoy kept half-closed sockets open, and a Linux TCP bug prevented those sockets from closing. Simultaneous packet captures at multiple points exposed the reordering, and a Linux kernel patch fixed the underlying TCP bug.