200MS P99 QUERY LATENCY OVER 100 BILLION VECTORS

Summary from the TLDR AI newsletter

turbopuffer wrote about building a 100B-vector search index. The post examines turbopuffer's architecture, travels up the modern memory hierarchy, zooms into a single CPU core, and backs out to the scale of a distributed cluster. Read the blog [19].