TLDR Dev · MISCELLANEOUS
ARE LLMS NOT GETTING BETTER?
Summary from the TLDR Dev newsletter
LLMs aren't continuously improving their programming abilities necessarily. LLM performance has gotten worse under the stricter criterion compared to the typical benchmarks. Statistical analysis of merge rates since early 2025 suggests a constant or piecewise constant trend, rather than a linear upward slope, indicating a stagnation in capability for over a year.