SIMPLE SYNTHETIC DATA REDUCES SYCOPHANCY

Summary from the TLDR AI newsletter

Sycophancy is when a model repeats and adopts a user's opinion. This happens more in larger models and instruction-tuned models. It can also occur in tasks when the opinion is irrelevant, leading to bubble-like behavior. Simple synthetic data fine-tuning can prevent this without harming overall performance.