IF AI IS MAKING THE TURING TEST OBSOLETE, WHAT MIGHT BE BETTER?

Summary from the TLDR newsletter

A team of researchers has proposed a novel framework that treats AI programs as if they were a participant in a psychological study. It has three steps: test the program in a set of experiments examining its inferences, test its understanding of its own way of reasoning, and examine, if possible, the cognitive adequacy of the source code for the program. While current generations of AI programs have come close to passing the Turing Test, the results don't imply that these programs can think and reason like humans. The new framework could be an alternative to the Turing Test for evaluating the intelligence of programs.