TLDR · PROGRAMMING, DESIGN & DATA SCIENCE

BUILDING A DISTRIBUTED CACHE FOR S3

clickhouse.com25 min read

Summary from the TLDR newsletter

Clickhouse built a distributed cache for cloud object storage - a shared, low-latency layer that gives all compute nodes fast access to hot data. This post looks at how hot data caching worked before, why object storage made it hard, and how the new architecture fixes it. It includes benchmarks.