TWO NOTIONS OF A GOAL: TARGET STATES VS. SUCCESS METRICS

Summary from the TLDR Product newsletter

Goals can mean either the states an agent aims for or the metrics used to judge success. Separating these ideas clarifies key AI alignment issues, especially how agents learn goals and why misalignment happens.