MODELS ARE GETTING DUMBER ON PURPOSE

Summary from the TLDR Dev newsletter

Recent advancements in AI models show that while their reasoning capabilities continue to improve per parameter, their factual recall has notably declined, suggesting a deliberate trade-off where knowledge is sacrificed for reasoning skills. This shift allows models to operate effectively by relying on external information sources to provide up-to-date facts, reducing issues like hallucination by enabling the model to reference and verify information against live data rather than fixed weights.