Flash Organizations: Crowdsourcing Complex Work by Structuring Crowds As Organizations

@article{Valentine2017FlashOC,
  title={Flash Organizations: Crowdsourcing Complex Work by Structuring Crowds As Organizations},
  author={Melissa A. Valentine and Daniela Retelny and Alexandra To and Negar Rahmati and Tulsee Doshi and Michael S. Bernstein},
  journal={Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems},
  year={2017}
}
This paper introduces flash organizations: crowds structured like organizations to achieve complex and open-ended goals. Microtask workflows, the dominant crowdsourcing structures today, only enable goals that are so simple and modular that their path can be entirely pre-defined. We present a system that organizes crowd workers into computationally-represented structures inspired by those used in organizations - roles, teams, and hierarchies - which support emergent and adaptive coordination… 

Figures and Tables from this paper

Managing Work Systems for Complex Work via Crowdworking Platforms - How to Orchestrate the Interplay of Crowds
TLDR
This research investigates how these crowdworking platforms can also successfully manage more complex work and presents measures to do so, classified along the core WST-elements processes and activities, participants, information, and technologies.
No Workflow Can Ever Be Enough: How Crowdsourcing Workflows Constrain Complex Work
TLDR
This paper uses an inductive mixed method approach to analyze behavior trace data, chat logs, survey responses and work artifacts to understand how workers enacted and adapted the crowdsourcing workflows, and indicates that complex work may remain a fundamental limitation of workflow-based crowdsourcing infrastructures.
Crowdsourcing Coordination: A Review and Research Agenda for Crowdsourcing Coordination Used for Macro-tasks
TLDR
This chapter examines the current approaches to crowd coordination in the HCI and CSCW literature, identifies shortcomings in the literature and proposes a research agenda directed at advancing the understanding of crowd coordination needed to address complex macro-tasks.
Crowdsourcing Creative Work
TLDR
A three-part classification of creative work on crowdsourcing platforms: creative tasks, creativity tests, and creativity judgements (also referred to as creative feedback) is proposed and computational artefacts are created to elicit authentic experiences from both crowd workers and requesters of crowdsourced creative work.
Unleashing the Potential of Crowd Work: The Need for a Post-Taylorism Crowdsourcing Model
Paid crowdsourcing connects task requesters to a globalized, skilled workforce that is available 24/7. In doing so, this new labor model promises not only to complete work faster and more efficiently
A Social Network Engaged Crowdsourcing Framework for Expert Tasks
TLDR
A social network engaged crowdsourcing framework is proposed and the preliminary study is conducted to explore its ability in performing the tasks with the need of domain-specific skills and knowledge.
Transforming Work Organization with Internal Crowds: a Process Theory
TLDR
A process ontology is applied on internal crowdsourcing as platform-based mode of work organization and it is illustrated that the emergence and constitution of STS is mainly driven by processes on a micro-level.
Exploring Real-Time Collaboration in Crowd-Powered Systems Through a UI Design Tool
TLDR
This paper investigates how requesters verbally communicate and collaborate with crowd workers to solve a complex task, and makes design recommendations that can inform the design of future real-time collaboration processes in crowdsourcing systems.
Optimized group formation for solving collaborative tasks
TLDR
The notion of collaboration among crowd workers is formalized and a comprehensive optimization model for task assignment in a collaborative crowdsourcing environment is proposed, and a series of efficient exact and approximation algorithms with provable theoretical guarantees are proposed.
Crowd and Community: Organizations and Occupations in Crowdsourced Work
Over the past two decades, firms have relied increasingly upon external workers rather than employees for their core production tasks. More recently, firms in the hightechnology and software
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 96 REFERENCES
Expert crowdsourcing with flash teams
TLDR
It is demonstrated that Foundry and flash teams enable crowdsourcing of a broad class of goals including design prototyping, course development, and film animation, in half the work time of traditional self-managed teams.
The future of crowd work
TLDR
This paper outlines a framework that will enable crowd work that is complex, collaborative, and sustainable, and lays out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation.
Collaboratively crowdsourcing workflows with turkomatic
TLDR
It is argued that Turkomatic's collaborative approach can be more successful than the conventional workflow design process and implications for the design of collaborative crowd planning systems are discussed.
The Crowd is a Collaborative Network
TLDR
Crowdworkers are not the independent, autonomous workers they are often assumed to be, but instead work within a social network of other crowdworkers to fulfill technical and social needs left by the platform they work on.
Huddler: Convening Stable and Familiar Crowd Teams Despite Unpredictable Availability
TLDR
This research enables effective crowd teams with Huddler, a system for workers to assemble familiar teams even under unpredictable availability and strict time constraints, using a dynamic programming algorithm to optimize for highly familiar teammates when individual availability is unknown.
Real-time crowd control of existing interfaces
TLDR
This paper presents mediation strategies for integrating the input of multiple crowd workers in real-time, evaluates these mediation strategies across several applications, and further validate Legion by exploring the space of novel applications that it enables.
Decision-Theoretic Control of Crowd-Sourced Workflows
TLDR
A planner is described, TURKONTROL, that formulates workflow control as a decision-theoretic optimization problem, trading off the implicit quality of a solution artifact against the cost for workers to achieve it.
Argonaut: Macrotask Crowdsourcing for Complex Data Processing
TLDR
Argonaut is presented, a framework that improves macrotask powered work quality using a hierarchical review and can identify the ideal trade-off between a single phase of review and multiple phases of review given a constrained review budget in order to maximize overall output quality.
CrowdForge: crowdsourcing complex work
TLDR
This work presents a general purpose framework for accomplishing complex and interdependent tasks using micro-task markets, a web-based prototype, and case studies on article writing, decision making, and science journalism that demonstrate the benefits and limitations of the approach.
Crowds in two seconds: enabling realtime crowd-powered interfaces
TLDR
This paper develops techniques that recruit synchronous crowds in two seconds and use them to execute complex search tasks in ten seconds, and offers empirically derived guidelines for a retainer system that is low-cost and produces on-demand crowds inTwo seconds.
...
1
2
3
4
5
...