TLDR AI · ENGINEERING & RESEARCH
VECTORIZED MAXSCORE OVER WAND: BUILDING FASTER TEXT SEARCH FOR HUMANS AND AGENTS
Summary from the TLDR AI newsletter
Designing fast search engines is a subtle optimization problem. It takes effort to select the right algorithm and then tune it to get the best out of the CPU. Agents write longer queries than humans, so it is becoming increasingly important for text search to scale well with the number of terms. For text search, this means the cursor has shifted more and more from WAND to MAXSCORE.