TLDR Data · MISCELLANEOUS

ENCODING OR COMPRESSION: WHY NOT BOTH?

cedardb.com9 min read

Summary from the TLDR Data newsletter

Encoding improves analytical query execution, while compression mainly reduces storage. Dictionary encoding and frame-of-reference enable fast comparisons, pruning, and SIMD operations. CedarDB's results suggest always encoding, then adding zstd only when the disk savings justify it.