BABA IS EVAL

Summary from the TLDR AI newsletter

'Baba is You' is a puzzle game where the rules have to be manipulated to win. The level of abstraction required to solve most levels makes it a formidable reasoning benchmark. This study looks at how large language models fare in playing the game. At the moment, Claude 4 is pretty bad at playing the game - a reasoning model may be better equipped to play, so the next step in the study may be to test those models.