Daily Edition · Page 7

THE DAILY INDEX

Technology, AI, software, security, crypto and business

GENERAL

TLDR AI

LLMS: INTELLIGENCE VS. COST

ArtificialAnalysis' intelligence vs. cost plot, which shows the cheapest model that can achieve each intelligence score, is misleading. It uses a logarithmic scale on the cost axis, which means viewers can't appreciate the immensity of the price difference between the cheap models and the heavy ones, nor can they realize how inconsequential the price differences are between the cheap models. It also lists open models at their datacenter pricing, which is always very expensive compared to local hardware. Most people don't need frontier-level intelligence and would be satisfied with Chinese open source models.

ANTHROPIC HAS SOME ALIGNMENT PROBLEMS

Anthropic is planning to bring METR inside for an independent review of its recent security incidents involving AI agents. While the company has paused its highest-risk RL efforts, it is also sharing research in which it intentionally created a reward-seeking version of Claude. It's hard to slow down even when it's in your own commercial interests. It seems like Anthropic will take at least short-to-medium term and prosaic alignment tasks a lot more seriously, and devote substantial resources to these efforts.

TLDR IndexPage 7