Practical guide to controlled experiments on the web: listen to your customers not to the hippo

  title={Practical guide to controlled experiments on the web: listen to your customers not to the hippo},
  author={Ron Kohavi and Randal M. Henne and Dan Sommerfield},
The web provides an unprecedented opportunity to evaluate ideas quickly using controlled experiments, also called randomized experiments (single factor or factorial designs), A/B tests (and their generalizations), split tests, Control/Treatment tests, and parallel flights. Controlled experiments embody the best scientific design for establishing a causal relationship between changes and their influence on user-observable behavior. We provide a practical guide to conducting online experiments… CONTINUE READING
Highly Influential
This paper has highly influenced 18 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 264 citations. REVIEW CITATIONS


Publications citing this paper.
Showing 1-10 of 184 extracted citations

264 Citations

Citations per Year
Semantic Scholar estimates that this publication has 264 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-6 of 6 references

Putting A/B Testing in Its Place. Alertbox

  • Nielsen, Jakob
  • [Online] Aug
  • 2005
Highly Influential
4 Excerpts

A Primer on A/B Testing

  • Chatham, Bob, Temkin, D Bruce, Amato, Michelle
  • s.l. : Forrester Research,
  • 2004
Highly Influential
6 Excerpts

Statistical Design and Analysis of Experiments With Applications to Engineering and Science. s.l

  • Mason, L Robert, Gunst, F Richard, Hess, L James
  • 1989
Highly Influential
6 Excerpts

Similar Papers

Loading similar papers…