HOW WE MADE SWE-BENCH 50X SMALLER

Summary from the TLDR AI newsletter

Logicstar shrank SWE-Bench Verified from 240 GiB to just 5 GiB. It can now be downloaded in under a minute, making large-scale evaluation and trace generation on cloud machines fast and painless. The team achieved this result by restructuring layers, trimming unnecessary files, and compressing the results. This article gets into details about how the smaller SWE-Bench Verified was created.