Increasing cheat robustness of crowdsourcing tasks

  title={Increasing cheat robustness of crowdsourcing tasks},
  author={Carsten Eickhoff and Arjen P. de Vries},
  journal={Information Retrieval},
Crowdsourcing successfully strives to become a widely used means of collecting large-scale scientific corpora. Many research fields, including Information Retrieval, rely on this novel way of data acquisition. However, it seems to be undermined by a significant share of workers that are primarily interested in producing quick generic answers rather than correct ones in order to optimise their time-efficiency and, in turn, earn more money. Recently, we have seen numerous sophisticated schemes of… CONTINUE READING
Highly Cited
This paper has 184 citations. REVIEW CITATIONS

8 Figures & Tables



Citations per Year

184 Citations

Semantic Scholar estimates that this publication has 184 citations based on the available data.

See our FAQ for additional information.