TLDR AI · MISCELLANEOUS
DID XAI LIE ABOUT GROK 3'S BENCHMARKS?
Summary from the TLDR AI newsletter
An OpenAI employee has accused Elon Musk's xAI of publishing misleading benchmark results for Grok 3 by omitting the "cons@64" metric, which boosts scores. xAI's graph suggested that Grok 3 was superior to OpenAI's models, but omitted the enhancement that OpenAI's models benefitted from. This dispute highlights ongoing issues with AI benchmarks and reporting transparency.