Incentive Alignment in Online Experimentation

Excerpt

arXiv:2610.05922v2 Announce Type: replace-cross Abstract: Evaluating the causal effect of new features is a central goal for online platforms. While recent literature addresses limited testing traffic via centralized portfolio optimization, this perspective abstracts away a critical institutional reality: experimentation is operationally decentralized. The experimenters who develop new features also dictate which hypotheses to test, and they are typically rewarded based on empirical average trea