VORTEX

Summary from the TLDR newsletter

Vortex is a toolkit for working with compressed Apache Arrow arrays in-memory, on-disk, and over-the-wire. It is a highly extensible and extremely fast framework for building a modern columnar file format. Vortex features a state-of-the-art, batteries-included reference implementation. It has dramatically faster random access reads and scans than Apache Parquet while preserving approximately the same compression ratio and write throughput.