WHY ANTHROPIC'S CLAUDE STILL HASN'T BEATEN POKÉMON

Summary from the TLDR newsletter

Claude Plays Pokémon has been struggling to make consistent progress in Pokémon, but even this sub-human level of performance could hold significant lessons for the quest toward artificial general intelligence. The AI model has been struggling to interpret the game's pixelated world as well as a human would, but it performs better in the text-based portions of the game. It has trouble remembering some of the information that it has learned and making sense of what it knows, sometimes inserting incorrect information into its knowledge base. The system's progress can vary quite a bit between runs. There are some signs it can tell when it doesn't know what it is doing and that it needs to be doing something different.