SCALING: THE STATE OF PLAY IN AI

Summary from the TLDR AI newsletter

LLMs like ChatGPT and Gemini are becoming increasingly capable as they scale up in size, data, and computing power, leading to improved performance across various tasks. Current Gen2 models like GPT-4 and Claude 3.5 are leading the market, with upcoming Gen3 models expected to further escalate capabilities and costs. The discovery of a new scaling law in AI, pertaining to increased "thinking" during inference, promises further advancements in AI performance beyond just model training.