Creativity on Paid Crowdsourcing Platforms

  title={Creativity on Paid Crowdsourcing Platforms},
  author={Jonas Oppenlaender and Kristy Milland and Aku Visuri and Panagiotis G. Ipeirotis and S. Hosio},
  journal={Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems},
Crowdsourcing platforms are increasingly being harnessed for creative work. The platforms' potential for creative work is clearly identified, but the workers' perspectives on such work have not been extensively documented. In this paper, we uncover what the workers have to say about creative work on paid crowdsourcing platforms. Through a quantitative and qualitative analysis of a questionnaire launched on two different crowdsourcing platforms, our results revealed clear differences between the… Expand

Figures, Tables, and Topics from this paper

What do crowd workers think about creative work?
This study illuminates what creative work is like for crowd workers on these two general-purpose crowdsourcing platforms, identifies several archetypal types of workers with different attitudes towards creative work, and discusses common pitfalls with creative work on crowdsourced platforms. Expand
HowWeWrite with Crowds
Writing is a common task for crowdsourcing researchers exploring complex and creative work. To better understand how we write with crowds, we conducted both a literature review of crowd-writingExpand
How We Write with Crowds
It is argued that the cognitive process theory of writing described by Flower and Hayes (1981), originally proposed as a theory of how solo writers write, offers a useful analytic lens for examining the design of crowd-writing systems. Expand
Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing
It is found that it is possible to reduce the burden on workers while still collecting high quality data, and a study of the correlation between qualifications and work quality on two NLP tasks is conducted. Expand
Karamad: A Voice-based Crowdsourcing Platform for Underserved Populations
Kamad is a voice-based crowdsourcing platform that allows workers in low-resource regions to complete crowd work using low-end phones and receive payments as mobile airtime balance and the usefulness, scalability, and sustainability of Karamad in Pakistan is explored. Expand
Conducting Malicious Cybersecurity Experiments on Crowdsourcing Platforms
Evaluating the effectiveness of defense technologies mandates the inclusion of a human element, specifically if these technologies target human cognition and emotions. One of the biggest challengesExpand
Assessing MyData Scenarios: Ethics, Concerns, and the Promise
This paper investigates people’s perceptions of various data management scenarios by measuring the perceived ethicality and level of felt concern concerning the scenarios, and contributes to the field of data ethics. Expand
Crowd-powered creativity support systems
This doctoral dissertation explores crowd-powered creativity support systems and covers a research arc from the fundamental prerequisites of leveraging crowds for creativity support to an accompanying set of case studies to clarify how complex creative work can be supported in practice. Expand
CrowdUI: Supporting Web Design with the Crowd
CrowdUI is presented, a web-based tool that enables members of the community of a website to visually express their design improvement ideas, frustrations and needs, and to send this feedback to the person in charge of designing or maintaining the website. Expand


More than fun and money. Worker Motivation in Crowdsourcing - A Study on Mechanical Turk
This work adapts different models from classic motivation theory, work motivation theory and Open Source Software Development to crowdsourcing markets and finds that the extrinsic motivational categories have a strong effect on the time spent on the platform. Expand
Crowdsourcing and Creativity
In studying creativity and techniques for enhancing the creative process, we utilized crowdsourcing through Amazon’s Mechanical Turk. Through our studies we found that in its current form, theExpand
A Fair Share of the Work?: The Evolving Ecosystem of Crowd Workers
Light is shed upon this system and all of its components, thus providing insights into the inner workings of the crowdsourcing platforms from the crowd's side and raises attention to the need for engaging in research and creating tools. Expand
DC2S2: Designing Crowd-powered Creativity Support Systems
This workshop brainstorm new crowdsourcing systems and concepts for supporting creativity, by bringing together researchers and industry professionals in a full-day workshop. Expand
Distributed analogical idea generation: inventing with crowds
It is shown that distributed analogical idea generation leads to better ideas than example-based approaches, and the conditions under which crowds generate good schemas and ideas are investigated. Expand
Flash Organizations: Crowdsourcing Complex Work by Structuring Crowds As Organizations
A deployment is reported in which flash organizations successfully carried out open-ended and complex goals previously out of reach for crowdsourcing, including product design, software development, and game production. Expand
Understanding Malicious Behavior in Crowdsourcing Platforms: The Case of Online Surveys
The prevalent malicious activity on crowdsourcing platforms is analyzed and different types of workers in the crowd are defined, a method to measure malicious activity is proposed, and guidelines for the efficient design of crowdsourced surveys are presented. Expand
Crowdsourcing Samples in Cognitive Science
Crowdsourcing data collection from research participants recruited from online labor markets is now common in cognitive science. We review who is in the crowd and who can be reached by the averageExpand
Crowdsourcing Versus the Laboratory: Towards Human-Centered Experiments Using the Crowd
This chapter reflects on the key factors to consider while transitioning from controlled laboratory experiments to large scale experiments in the crowd. Expand
A taxonomy of microtasks on the web
A two-level categorization scheme for tasks, based on an extensive study of 1000 workers on CrowdFlower, and insights into certain aspects of crowd behaviour; the task affinity of workers, effort exerted by workers to complete tasks of various types, and their satisfaction with the monetary incentives are presented. Expand