TLDR Web Dev · ARTICLES & TUTORIALS

HOW THE COLOSSUS STATEFUL PROTOCOL BENEFITS RAPID STORAGE

cloud.google.com7 min read

Summary from the TLDR Web Dev newsletter

Rapid Storage on Google Cloud overcomes object storage limitations by using Colossus, Google's internal file system, to get sub-millisecond latency. Colossus provides a stateful protocol where clients get handles containing file storage information, allowing for direct data access and low-latency durable appends. Rapid Storage uses gRPC-based streaming with these handles, which lets user authorization be front-loaded, provides subsequent reads/writes directly to Colossus, and has error handling during stream interruptions.