BASE MODELS STOPPED BEING THE BOTTLENECK

Summary from the TLDR AI newsletter

Open models have improved significantly in just a few months. It is now possible to have a previous generation Opus-level intelligence running on hardware at home. Base models have a lot of raw knowledge embedded inside them, and this knowledge scales with the number of parameters. These models can be pruned and still be good at specific tasks.