Are your participants gaming the system?: screening mechanical turk workers

@inproceedings{Downs2010AreYP,
  title={Are your participants gaming the system?: screening mechanical turk workers},
  author={Julie S. Downs and Mandy B. Holbrook and Steve Sheng and Lorrie Faith Cranor},
  booktitle={CHI},
  year={2010}
}
In this paper we discuss a screening process used in conjunction with a survey administered via Amazon.com's Mechanical Turk. We sought an easily implementable method to disqualify those people who participate but don't take the study tasks seriously. By using two previously pilot tested screening questions, we identified 764 of 1,962 people who did not answer conscientiously. Young men seem to be most likely to fail the qualification task. Those that are professionals, students, and non… CONTINUE READING
Highly Cited
This paper has 323 citations. REVIEW CITATIONS

4 Figures & Tables

Topics

Statistics

0204060201020112012201320142015201620172018
Citations per Year

323 Citations

Semantic Scholar estimates that this publication has 323 citations based on the available data.

See our FAQ for additional information.