Reputation as a sufficient condition for data quality on Amazon Mechanical Turk.

@article{Peer2014ReputationAA,
  title={Reputation as a sufficient condition for data quality on Amazon Mechanical Turk.},
  author={Eyal Peer and Joachim Vosgerau and Alessandro Acquisti},
  journal={Behavior research methods},
  year={2014},
  volume={46 4},
  pages={1023-31}
}
Data quality is one of the major concerns of using crowdsourcing websites such as Amazon Mechanical Turk (MTurk) to recruit participants for online behavioral studies. We compared two methods for ensuring data quality on MTurk: attention check questions (ACQs) and restricting participation to MTurk workers with high reputation (above 95% approval ratings). In Experiment 1, we found that high-reputation workers rarely failed ACQs and provided higher-quality data than did low-reputation workers… CONTINUE READING
Recent Discussions
This paper has been referenced on Twitter 19 times over the past 90 days. VIEW TWEETS

From This Paper

Figures, tables, results, connections, and topics extracted from this paper.
128 Extracted Citations
16 Extracted References
Similar Papers

Citing Papers

Publications influenced by this paper.
Showing 1-10 of 128 extracted citations

Referenced Papers

Publications referenced by this paper.
Showing 1-10 of 16 references

Similar Papers

Loading similar papers…