CAN FOUNDATION MODELS LABEL DATA LIKE HUMANS?

Summary from the TLDR AI newsletter

The recent hype in language models has led to statements like "our model is preferred to ChatGPT N% of the time". This statement usually hides the fact that GPT4 was the model doing the preferring. Wrapped up in that is all sorts of questions about calibration, reliability, and the plain fact that GPT4 prefers models that output more tokens per response. This blog dives into these details and the Open LLM leaderboard.