MIGRATING BILLIONS OF RECORDS: MOVING OUR ACTIVE DNS DATABASE WHILE IT'S IN USE

Summary from the TLDR Web Dev newsletter

Cloudflare migrated its DNS database to a new cluster. The process involved separating DNS record data from zone data, creating a new internal DNS Records gRPC API, and building a custom Change Data Capture and Transfer Service (CDCTS). The CDCTS enabled near real-time data transfer. Afterwards, Cloudflare saw an improvement in its DNS Records API performance.