A process, a survey score or a metric starts as a stand-in for the goal and quietly becomes the goal.
Whatever you can measure and reward will be maximised literally, including the gaps between the measure and the goal.
AI product and risk discussions, designing any metric or bonus scheme, and evaluating a model's objective.
From The Alignment Problem · Brian Christian
Check whether the metric is still the goal or has become the goal, and reserve the heavy process for decisions that cannot be undone.
Product and leadership questions, assessing a large company's culture, and deciding how much process a decision deserves.
From Amazon's 2016 letter to shareholders (Day 1) · Jeff Bezos
Measure what changed for the customer, not what was shipped; a team given an outcome behaves differently from one given a list.
Product interviews at large companies, metrics questions, and any discussion of how a team should be judged.
From Escaping the Build Trap · Melissa Perri