THE KOLMOGOROV TEST: COMPRESSION BY CODE GENERATION

Summary from the TLDR AI newsletter

Meta has introduced a new benchmark for testing a language model's reasoning and knowledge. The test presents the language model with a long sequence of data and requires the model to output the shortest program that regenerates the sequences and halts. This is known as Kolmogorov compression and is uncomputable in polynomial time. The test requires strong reasoning abilities.