AA-OMNISCIENCE

Summary from the TLDR AI newsletter

AA-Omniscience is a benchmark for knowledge and hallucination across more than 40 topics. It punishes hallucinations by deducting points when models guess rather than admitting they do not know the answer. The benchmark complements the Artificial Analysis Intelligence Index by incorporating the measurement of knowledge and probability of hallucination. This thread contains the benchmark results from testing cutting-edge models against AA-Omniscience.