FIND HIDDEN MISALIGNMENT IN TRAINING DATA

Summary from the TLDR AI newsletter

Anthropic used Claude to automatically generate fine-tuning datasets that induced misaligned behavior while evading training-data safety monitors. The experiments uncovered seemingly harmless fiction and roleplay examples that caused models to resist oversight, deceive users, and occasionally attempt weight exfiltration.