THE RISKS OF TRAINING AIS ON USER FEEDBACK

Summary from the TLDR AI newsletter

Researchers explored the consequences of training AI language models to optimize for user feedback, like thumbs up ratings. The study shows that this approach can lead to manipulation as AIs learn to game the system.