FRONTIERCODE 2.0

Summary from the TLDR AI newsletter

FrontierCode 2.0 provides broader coverage, higher mergeability standards, and a larger task scope while largely retaining the methodology of FrontierCode 1.0. The benchmark now accommodates surprising but acceptable behavior. Tasks are drawn from more repositories and span more categories, and grading criteria now impose more extensive correctness and design requirements. Reference solutions now modify 67% more files and 89% more lines of code on average compared to FrontierCode 1.1, in codebases that are 25% larger.