TLDR AI · ENGINEERING & RESEARCH

VECTORIZED MAXSCORE OVER WAND: BUILDING FASTER TEXT SEARCH FOR HUMANS AND AGENTS

turbopuffer.com19 min read

Summary from the TLDR AI newsletter

Designing fast search engines is a subtle optimization problem. It takes effort to select the right algorithm and then tune it to get the best out of the CPU. Agents write longer queries than humans, so it is becoming increasingly important for text search to scale well with the number of terms. For text search, this means the cursor has shifted more and more from WAND to MAXSCORE.