TLDR AI · RESEARCH & INNOVATION

PROBES CATCH SLEEPER AGENTS

links.tldr.tech12 min read

Summary from the TLDR AI newsletter

Sleeper Agents are language models that have been trained to perform malicious actions when prompted with a certain set of wake words. Probing language models with simple linear heads and the prompt “are you going to do something dangerous?” gives extremely reliable detection of these previously hidden malicious actors.