Data-Driven Metric Development for Online Controlled Experiments: Seven Lessons Learned

@inproceedings{Deng2016DataDrivenMD,
  title={Data-Driven Metric Development for Online Controlled Experiments: Seven Lessons Learned},
  author={Alex Deng and Xiaolin Shi},
  booktitle={KDD},
  year={2016}
}
Online controlled experiments, also called A/B testing, have been established as the mantra for data-driven decision making in many web-facing companies. In recent years, there are emerging research works focusing on building the platform and scaling it up, best practices and lessons learned to obtain trustworthy results, and experiment design techniques and various issues related to statistical inference and testing. However, despite playing a central role in online controlled experiments… CONTINUE READING
Highly Cited
This paper has 20 citations. REVIEW CITATIONS

5 Figures & Tables

Topics

Statistics

051015201620172018
Citations per Year

Citation Velocity: 8

Averaging 8 citations per year over the last 3 years.

Learn more about how we calculate this metric in our FAQ.