Utility data annotation with Amazon Mechanical Turk

@article{Sorokin2008UtilityDA,
  title={Utility data annotation with Amazon Mechanical Turk},
  author={Alexander Sorokin and David A. Forsyth},
  journal={2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops},
  year={2008},
  pages={1-8}
}
We show how to outsource data annotation to Amazon Mechanical Turk. Doing so has produced annotations in quite large numbers relatively cheaply. The quality is good, and can be checked and controlled. Annotations are produced quickly. We describe results for several different annotation problems. We describe some strategies for determining when the task is well specified and properly priced. 

From This Paper

Topics from this paper.

Citations

Publications citing this paper.
SHOWING 1-10 OF 413 CITATIONS, ESTIMATED 46% COVERAGE

899 Citations

050100'10'13'16'19
Citations per Year
Semantic Scholar estimates that this publication has 899 citations based on the available data.

See our FAQ for additional information.

References

Publications referenced by this paper.
SHOWING 1-10 OF 22 REFERENCES

Caltech-256 object category dataset

  • G. Griffin, A. Holub, P. Perona
  • Technical Report 7694, California Institute of…
  • 2007
2 Excerpts

Similar Papers

Loading similar papers…