TLDR AI · RESEARCH & INNOVATION
BINARY SEARCH VECTORS
Summary from the TLDR AI newsletter
Searching over embedding vectors is a key to RAG pipelines. If you replace the fp32 numbers with a single 0 or 1, then use a KNN clusterer and reranker, you can maintain performance while shrinking memory requirements 30x.