TLDR Dev · MISCELLANEOUS

ARE LLMS NOT GETTING BETTER?

entropicthoughts.com3 min read

Summary from the TLDR Dev newsletter

LLMs aren't continuously improving their programming abilities necessarily. LLM performance has gotten worse under the stricter criterion compared to the typical benchmarks. Statistical analysis of merge rates since early 2025 suggests a constant or piecewise constant trend, rather than a linear upward slope, indicating a stagnation in capability for over a year.