Analyzing the Amazon Mechanical Turk marketplace

@article{Ipeirotis2010AnalyzingTA,
  title={Analyzing the Amazon Mechanical Turk marketplace},
  author={Panagiotis G. Ipeirotis},
  journal={XRDS: Crossroads, The ACM Magazine for Students},
  year={2010},
  volume={17},
  pages={16 - 21}
}
An associate professor at New York Universitys Stern School of Business uncovers answers about who are the employers in paid crowdsourcing, what tasks they post, and how much they pay. 
View on ACM
archive.nyu.edu
839 Citations
Highly Influential Citations
89
Background Citations
365
Methods Citations
115
Results Citations
44

839 Citations

Citation Type

Citation Type

Accounting for Market Frictions and Power Asymmetries in Online Labor Markets
Amazon Mechanical Turk (AMT) is an online labor market that defines itself as “a marketplace for work that requires human intelligence.” Early advocates and developers of crowdsourcing platforms… Expand
Recruiting Individuals to a Crowdsourcing Community: Applying Motivational Categories to an Ad Copy Test
This study operationalizes different motivational categories to participate in crowdsourcing and tests them with a series of advertisements in different countries. We found that internalized… Expand
Can Reputation Discipline the Gig Economy? Experimental Evidence from an Online Labor Market
TLDR
The effects of employer reputation in an online labor market (Amazon Mechanical Turk) in which employers may decline to pay workers while keeping their work product are examined, finding that working only for good employers yields 40% higher wages. Expand
Crowdsourcing Task Marketplaces
TLDR
Detailed statistics of the popular Amazon Mechanical Turk marketplace are discussed to provide insights in task properties and requester behavior and novel techniques to rank communities and requesters are presented by using a graph-based algorithm. Expand
Monopsony in Online Labor Markets
On-demand labor platforms make up a large part of the “gig economy.” We quantify the extent of monopsony power in one of the largest on-demand labor platforms, Amazon Mechanical Turk (MTurk), by… Expand
Service-Oriented Crowdsourcing
  • D. Schall
  • Computer Science
  • SpringerBriefs in Computer Science
  • 2012
This chapter gives an introduction to human computation and crowdsourcing techniques. Next, the key features of human task marketplaces such as Amazon Mechanical Turk are briefly outlined. In the… Expand
Crowds, Gigs, and Super Sellers: A Measurement Study of a Supply-Driven Crowdsourcing Marketplace
TLDR
This paper presents a comprehensive data-driven measurement study of one prominent supply-driven marketplace – Fiverr – wherein it identifies the key features distinguishing “super sellers” from regular participants and develops a machine learning based approach for inferring the quality of gigs. Expand
Mechanical Turk and Financial Dependency on Crowdsourcing
TLDR
This paper investigates whether workers who are financially dependent on income from Mechanical Turk produce work of different quality than workers who is not financially dependenton Mechanical Turk. Expand
Anatomy of a Crowdsourcing Platform - Using the Example of Microworkers.com
TLDR
An inside view of the usage data from Micro workers is given and it is shown that there are significant differences to the well studied MTurk. Expand
Can Reputation Discipline the Gig Economy?: Experimental Evidence From an Online Labor Market
Just as employers face uncertainty when hiring workers, workers also face uncertainty when accepting employment, and bad employers may opportunistically depart from expectations, norms, and laws.… Expand
...
1
2
3
4
5
...

References

SHOWING 1-8 OF 8 REFERENCES
Who are the crowdworkers?: shifting demographics in mechanical turk
TLDR
How the worker population has changed over time is described, shifting from a primarily moderate-income, U.S. based workforce towards an increasingly international group with a significant population of young, well-educated Indian workers. Expand
Task search in a human computation market
TLDR
The main findings are that on a large scale, workers sort by which tasks are most recently posted and which have the largest number of tasks available and that at least some employers try to manipulate the position of their task in the search results to exploit the tendency to search for recently posted tasks. Expand
Demographics of Mechanical Turk
We present the results of a survey that collected information about the demographics of participants on Amazon Mechanical Turk, together with information about their level of activity and motivation… Expand
The origin of bursts and heavy tails in human dynamics
TLDR
It is shown that the bursty nature of human behaviour is a consequence of a decision-based queuing process: when individuals execute tasks based on some perceived priority, the timing of the tasks will be heavy tailed, with most tasks being rapidly executed, whereas a few experience very long waiting times. Expand
Priority Assignment in Waiting Line Problems
  • A. Cobham
  • Mathematics, Computer Science
  • Oper. Res.
  • 1954
TLDR
The average elapsed time between the arrival in the line of a unit of a given priority and its admission to the facility for servicing is useful in evaluating the procedure by which priority assignments are made. Expand
Demographics of Mechanical Turk. working paper CeDER-10-01
  • 2010
Demographics of Mechanical Turk. working paper CeDER-10-01, New York University, Stern School of Business. Available at http://hdl.handle.net/2451/29585
  • 2010
shifting demographics in mechanical turk
  • In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems
  • 2010