TLDR Web Dev · ARTICLES & TUTORIALS
HOW THE COLOSSUS STATEFUL PROTOCOL BENEFITS RAPID STORAGE
Summary from the TLDR Web Dev newsletter
Rapid Storage on Google Cloud overcomes object storage limitations by using Colossus, Google's internal file system, to get sub-millisecond latency. Colossus provides a stateful protocol where clients get handles containing file storage information, allowing for direct data access and low-latency durable appends. Rapid Storage uses gRPC-based streaming with these handles, which lets user authorization be front-loaded, provides subsequent reads/writes directly to Colossus, and has error handling during stream interruptions.