DIG.BENCH

Summary from the TLDR AI newsletter

dig.bench is a benchmark that measures whether an agent can experiment to discover a game's unknown rules. It contains 70 text-based games, 21 that have been publicly released. Progress is scored by whether the game can be beaten within a limited number of steps. Humans can make the discoveries necessary to solve even the hardest games, while the best models struggle to beat games in the top tier.