TLDR AI · RESEARCH & INNOVATION

BINARY SEARCH VECTORS

blog.pgvecto.rs12 min read

Summary from the TLDR AI newsletter

Searching over embedding vectors is a key to RAG pipelines. If you replace the fp32 numbers with a single 0 or 1, then use a KNN clusterer and reranker, you can maintain performance while shrinking memory requirements 30x.