THE LONG CONTEXT RAG CAPABILITIES OF OPENAI O1 AND GOOGLE GEMINI

Summary from the TLDR Web Dev newsletter

This blog post presents a benchmark of long context Retrieval Augmented Generation (RAG) capabilities for OpenAI's o1 models and Google's Gemini 1.5 models. OpenAI's o1 models outperform other models on long context RAG benchmarks up to 128,000 tokens, while Google's Gemini 1.5 models maintain consistent performance at extremely long contexts up to 2 million tokens, albeit with lower overall accuracy.