Task search in a human computation market

@inproceedings{Chilton2010TaskSI,
  title={Task search in a human computation market},
  author={Lydia B. Chilton and John Joseph Horton and Rob Miller and Shiri Azenkot},
  booktitle={HCOMP '10},
  year={2010}
}
In order to understand how a labor market for human computation functions, it is important to know how workers search for tasks. This paper uses two complementary methods to gain insight into how workers search for tasks on Mechanical Turk. First, we perform a high frequency scrape of 36 pages of search results and analyze it by looking at the rate of disappearance of tasks across key ways Mechanical Turk allows workers to sort tasks. Second, we present the results of a survey in which we paid… Expand
Exploring task properties in crowdsourcing - an empirical study on mechanical turk
TLDR
A series of explorative studies on task properties on MTurk implies that other factors than demographics influence workers’ task selection and contributes to a better understanding of task choice. Expand
Crowdsourcing a HIT: Measuring Workers' Pre-Task Interactions on Microtask Markets
TLDR
This work investigates how four HIT design features (value proposition, branding, quality of presentation, and intrinsic motivation) affect conversion rates and finds that crowd workers prefer commercial entities to non-profit or university requesters. Expand
Workers' Task Choice in Crowdsourcing and Human Computation Markets
TLDR
This process is outlined and a structural model showing the criteria that workers use to choose tasks is proposed, based on the person-job fit theory, which includes the measures demands-abilities fit and needs-supplies fit, in order to explain the work intention. Expand
Crowdsourcing a HIT : Measuring Workers ’ Pre-Interactions on Microtask Markets
The ability to entice and engage crowd workers to participate in human intelligence tasks (HITs) is critical for many human computation systems and large-scale experiments. While various metrics haveExpand
Towards Task Recommendation in Micro-Task Markets
TLDR
It is posited that understanding user skill sets and presenting them with suitable tasks not only maximizes the over quality of the output, but also attempts to maximize the benefit to the user in terms of more successfully completed tasks. Expand
Task recommendation in crowdsourcing systems
In crowdsourcing systems, tasks are distributed to networked people to complete such that a company's production cost can be greatly reduced. Obviously, it is not efficient that the amount of timeExpand
Predicting the Working Time of Microtasks Based on Workers' Perception of Prediction Errors
TLDR
A computational technique for predicting microtask working times based on past experiences of workers regarding similar tasks and challenges encountered in defining evaluation and/or objective functions have been described based on the tolerance demonstrated by workers with regard to prediction errors. Expand
Feedback and Performance in Crowd Work: a Real Effort Experiment
TLDR
Evidence is found that in rank order tournaments, performance feedback tends to have a negative impact on workers’ performance, and providing performance feedback might not be advisable in crowd labor markets. Expand
Answering search queries with CrowdSearcher
TLDR
CrowdSearcher is proposed, a novel search paradigm that embodies crowds as first-class sources for the information seeking process, by showing how search systems can drive and encapsulate social systems. Expand
Predicting the Working Time of Microtasks Based on Workers' Perception of Prediction Errors
TLDR
A computational technique for predicting microtask working times based on past experiences of workers regarding similar tasks and challenges encountered in defining evaluation and/or objective functions have been described based on the tolerance demonstrated by workers with regard to prediction errors. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 20 REFERENCES
The labor economics of paid crowdsourcing
TLDR
A model of workers supplying labor to paid crowdsourcing projects is presented and a novel method for estimating a worker's reservation wage - the key parameter in the labor supply model - is introduced. Expand
Sellers' problems in human computation markets
TLDR
The sellers in one human computation market, Mechanical Turk, are characterized, and some of the challenges they face are described, and several projects developed to approach these problems are listed. Expand
Demographics of Mechanical Turk
We present the results of a survey that collected information about the demographics of participants on Amazon Mechanical Turk, together with information about their level of activity and motivationExpand
Financial incentives and the "performance of crowds"
TLDR
It is found that increased financial incentives increase the quantity, but not the quality, of work performed by participants, where the difference appears to be due to an "anchoring" effect. Expand
The online laboratory: conducting experiments in a real labor market
TLDR
The views on the potential role that online experiments can play within the social sciences are presented, and software development priorities and best practices are recommended. Expand
Wiring the Labor Market
Workers and jobs are naturally heterogeneous and the quality of their interaction when paired is difficult to forecast. The Internet promises to open new channels for worker-firm communications. WhatExpand
The PageRank Citation Ranking : Bringing Order to the Web
TLDR
This paper describes PageRank, a mathod for rating Web pages objectively and mechanically, effectively measuring the human interest and attention devoted to them, and shows how to efficiently compute PageRank for large numbers of pages. Expand
Labeling images with a computer game
TLDR
A new interactive system: a game that is fun and can be used to create valuable output that addresses the image-labeling problem and encourages people to do the work by taking advantage of their desire to be entertained. Expand
Crowdsourcing, attention and productivity
We show through an analysis of a massive data set from YouTube that the productivity exhibited in crowdsourcing exhibits a strong positive dependence on attention, measured by the number ofExpand
TagATune: A Game for Music and Sound Annotation
TLDR
The rationale, design and preliminary results from a pilot study using a prototype of TagATune to label a subset of the FreeSound database, which aims to extract descriptions of sounds and music from human players. Expand
...
1
2
...