TLDR AI · DEEP DIVES & ANALYSIS

HOW I GOT THE HIGHEST SCORE ON ARC-AGI AGAIN SWAPPING PYTHON FOR ENGLISH

jeremyberman.substack.com9 min read

Summary from the TLDR AI newsletter

ARC-AGI is an intelligence test designed to measure abstract pattern recognition. Humans are able to readily solve the puzzles on the test, but large language models struggle significantly. This post discusses how an AI researcher was able to achieve a new high score of 79.6% on ARC v2 at $8.42 per task and 29.4% on ARC v2, a new state-of-the-art.