TLDR Data · MISCELLANEOUS
I TOLD AN AI AGENT THAT ITS WRONG ANSWERS WERE RIGHT. ONE MODEL BELIEVED ME
Summary from the TLDR Data newsletter
In most cases, flipping the reward labels in an agent's memory barely changes how it learns. This test hid a rule only the labels could reveal. With true labels, GPT-6 Sol scored 94.4 out of 100 on its last six trials, and with flipped labels 7.8. Claude Haiku 5.5 improved less, and Qwen3 4B barely moved.