RAG IS DEAD, CONTEXT ENGINEERING IS KING

Summary from the TLDR AI newsletter

In this interview, Jeff Huber from Chroma talks about what matters in vector databases, why modern search for AI is different, and how to ship systems that don't rot as context grows. Context engineering is the job of figuring out what should be in the context window at any given LLM generation step. It involves an inner loop, setting up the context window 'this time', and an outer loop that involves getting better at filling the context window with only relevant information.