Analyzing the Amazon Mechanical Turk marketplace

@article{Ipeirotis2010AnalyzingTA,
  title={Analyzing the Amazon Mechanical Turk marketplace},
  author={Panagiotis G. Ipeirotis},
  journal={XRDS: Crossroads, The ACM Magazine for Students},
  year={2010},
  volume={17},
  pages={16 - 21}
}
An associate professor at New York Universitys Stern School of Business uncovers answers about who are the employers in paid crowdsourcing, what tasks they post, and how much they pay. 
View on ACM
archive.nyu.edu
901 Citations
Highly Influential Citations
88
Background Citations
385
Methods Citations
128
Results Citations
46

901 Citations

Accounting for Market Frictions and Power Asymmetries in Online Labor Markets
Amazon Mechanical Turk (AMT) is an online labor market that defines itself as “a marketplace for work that requires human intelligence.” Early advocates and developers of crowdsourcing platforms…
Recruiting Individuals to a Crowdsourcing Community: Applying Motivational Categories to an Ad Copy Test
This study operationalizes different motivational categories to participate in crowdsourcing and tests them with a series of advertisements in different countries. We found that internalized…
Monopsony in Online Labor Markets
Despite the seemingly low switching and search costs of on-demand labor markets like Amazon Mechanical Turk, we find substantial monopsony power, as measured by the elasticity of labor supply facing…
Can Reputation Discipline the Gig Economy?: Experimental Evidence From an Online Labor Market
In two experiments, we examine the effects of employer reputation in an online labor market (Amazon Mechanical Turk) in which employers may decline to pay workers while keeping their work product.…
Service-Oriented Crowdsourcing
  • D. Schall
  • Computer Science, Business
    SpringerBriefs in Computer Science
  • 2012
This chapter gives an introduction to human computation and crowdsourcing techniques. Next, the key features of human task marketplaces such as Amazon Mechanical Turk are briefly outlined. In the…
Crowds, Gigs, and Super Sellers: A Measurement Study of a Supply-Driven Crowdsourcing Marketplace
TLDR
This paper presents a comprehensive data-driven measurement study of one prominent supply-driven marketplace – Fiverr – wherein it identifies the key features distinguishing “super sellers” from regular participants and develops a machine learning based approach for inferring the quality of gigs.
Mechanical Turk and Financial Dependency on Crowdsourcing
TLDR
This paper investigates whether workers who are financially dependent on income from Mechanical Turk produce work of different quality than workers who is not financially dependenton Mechanical Turk.
Workers in the Crowd: The Labour Market Impact of the Online Platform Economy
We compare individuals engaged in online crowdwork against workers in traditional occupations from the United States and Europe, investigating the determinants of access into crowd employment and…
Quality-Based Pricing for Crowdsourced Workers
TLDR
This work presents a comprehensive scheme for managing quality of crowdsourcing processes, and describes a pricing scheme that pays workers based on their expected quality, reservation wage, and expected lifetime, and accommodates measurement uncertainties and allows the workers to receive a fair wage, even in the presence of temporary incorrect estimations of quality.
Amazon Mechanical Turk and the Commodification of Labour
Crowd employment platforms enable firms to source labour and expertise by leveraging Internet technology. Rather than offshoring jobs to low‐cost geographies, functions once performed by internal…
...
...

References

SHOWING 1-8 OF 8 REFERENCES
Who are the crowdworkers?: shifting demographics in mechanical turk
TLDR
How the worker population has changed over time is described, shifting from a primarily moderate-income, U.S. based workforce towards an increasingly international group with a significant population of young, well-educated Indian workers.
Task search in a human computation market
TLDR
The main findings are that on a large scale, workers sort by which tasks are most recently posted and which have the largest number of tasks available and that at least some employers try to manipulate the position of their task in the search results to exploit the tendency to search for recently posted tasks.
Demographics of Mechanical Turk
We present the results of a survey that collected information about the demographics of participants on Amazon Mechanical Turk, together with information about their level of activity and motivation…
Priority Assignment in Waiting Line Problems
TLDR
The average elapsed time between the arrival in the line of a unit of a given priority and its admission to the facility for servicing is useful in evaluating the procedure by which priority assignments are made.
The origin of bursts and heavy tails in human dynamics
TLDR
It is shown that the bursty nature of human behaviour is a consequence of a decision-based queuing process: when individuals execute tasks based on some perceived priority, the timing of the tasks will be heavy tailed, with most tasks being rapidly executed, whereas a few experience very long waiting times.
Demographics of Mechanical Turk. working paper CeDER-10-01
  • 2010
Demographics of Mechanical Turk. working paper CeDER-10-01, New York University, Stern School of Business. Available at http://hdl.handle.net/2451/29585
  • 2010
shifting demographics in mechanical turk
  • In Proceedings of the 28th of the international Conference Extended Abstracts on Human Factors in Computing Systems
  • 2010