VERIFIABLE DOMAINS WILL EAT THE WORLD

Summary from the TLDR AI newsletter

When it comes to word selection, 'best' exists in the domain of the unverifiable. There's no universally applicable, objective measure of 'the best next word' that an LLM training run can target for optimization because 'best' depends on the author's intention and meaning. As there is no way to quantify how many users are getting the second-best word, or to measure the cost of these users getting a suboptimal word, the concept of 'the best words in the best order' may as well not even exist.