LANCE

Summary from the TLDR newsletter

Lance is a modern data format for machine learning. It provides faster random access, a vector index, data versioning, and more. Lance is compatible with pandas, duckdb, polars, and pyarrow. It can be used for building search engines and feature stores, large-scale ML training, and storing, querying, and inspecting deeply nested data.