SUBLIMINAL LEARNING IN LANGUAGE MODELS

Summary from the TLDR AI newsletter

Anthropic has explored how language models can inherit behavioral traits such as preferences or goals from other models through training data that appears unrelated. This effect only occurs when the teacher and student models share the same base architecture, suggesting hidden signals in the data can transmit unintended behavior.