TLDR · MISCELLANEOUS

THE SPECTER OF NEURALESE

astralcodexten.com20 min read

Summary from the TLDR newsletter

Neuralese recurrence is a hypothetical technology that would allow AIs to think dangerous thoughts without getting detected. OpenAI's new Astra model uses a reasoning technique called recurrent depth that makes the model's chain of thought more difficult to monitor by allowing it to operate outside of the sequential thinking that characterizes most reasoning models. There is an emerging taboo on creating dangerous neuralese AIs. It is unclear whether OpenAI broke that taboo, as a clear line has yet to be drawn.