Quality through flow and immersion: gamifying crowdsourced relevance assessments

  title={Quality through flow and immersion: gamifying crowdsourced relevance assessments},
  author={Carsten Eickhoff and Christopher G. Harris and Arjen P. de Vries and Padmini Srinivasan},
Crowdsourcing is a market of steadily-growing importance upon which both academia and industry increasingly rely. However, this market appears to be inherently infested with a significant share of malicious workers who try to maximise their profits through cheating or sloppiness. This serves to undermine the very merits crowdsourcing has come to represent. Based on previous experience as well as psychological insights, we propose the use of a game in order to attract and retain a larger share… CONTINUE READING
Highly Cited
This paper has 147 citations. REVIEW CITATIONS
82 Citations
3 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 82 extracted citations

147 Citations

Citations per Year
Semantic Scholar estimates that this publication has 147 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.
Showing 1-3 of 3 references

Overview of the TREC 2011 Crowdsourcing Track (Conference Notebook)

  • M. Lease, G. Kazai
  • 2011
Highly Influential
13 Excerpts

Flow: The psychology of optimal experience

  • M. Csikszentmihalyi
  • Harper Perennial,
  • 1991
Highly Influential
6 Excerpts

Similar Papers

Loading similar papers…