TLDR AI · MISCELLANEOUS

DID XAI LIE ABOUT GROK 3'S BENCHMARKS?

techcrunch.com3 min read

Summary from the TLDR AI newsletter

An OpenAI employee has accused Elon Musk's xAI of publishing misleading benchmark results for Grok 3 by omitting the "cons@64" metric, which boosts scores. xAI's graph suggested that Grok 3 was superior to OpenAI's models, but omitted the enhancement that OpenAI's models benefitted from. This dispute highlights ongoing issues with AI benchmarks and reporting transparency.