LLMS: INTELLIGENCE VS. COST

Summary from the TLDR AI newsletter

ArtificialAnalysis' intelligence vs. cost plot, which shows the cheapest model that can achieve each intelligence score, is misleading. It uses a logarithmic scale on the cost axis, which means viewers can't appreciate the immensity of the price difference between the cheap models and the heavy ones, nor can they realize how inconsequential the price differences are between the cheap models. It also lists open models at their datacenter pricing, which is always very expensive compared to local hardware. Most people don't need frontier-level intelligence and would be satisfied with Chinese open source models.