SWE-BENCH VERIFIED STOPPED BEING A FRONTIER CODING METRIC

Summary from the TLDR AI newsletter

SWE-bench Verified no longer reliably measures frontier coding progress because many tasks have flawed tests that rejected correct fixes and because benchmark contamination has made training exposure a significant factor in scores.