TLDR AI · ENGINEERING & RESEARCH

MEASURING PROGRESS TOWARD AGI: A COGNITIVE FRAMEWORK

blog.google3 min read

Summary from the TLDR AI newsletter

Google DeepMind released a paper outlining a cognitive taxonomy to measure AI progress toward AGI, identifying 10 key cognitive abilities like perception, learning, and reasoning. It proposes a three-stage evaluation protocol comparing AI performance to human benchmarks. A Kaggle hackathon, with a $200,000 prize pool, invites researchers to develop evaluations for five under-assessed abilities, using a new Community Benchmarks platform.