• Publications
  • Influence
Crowdsourcing user studies with Mechanical Turk
Although micro-task markets have great potential for rapidly collecting user measurements at low costs, it is found that special care is needed in formulating tasks in order to harness the capabilities of the approach. Expand
The future of crowd work
This paper outlines a framework that will enable crowd work that is complex, collaborative, and sustainable, and lays out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation. Expand
Harnessing the wisdom of crowds in wikipedia: quality through coordination
Examination of how the number of editors in Wikipedia and the coordination methods they use affect article quality demonstrated the critical importance of coordination in effectively harnessing the "wisdom of the crowd" in online production environments. Expand
Bridging the gap between physical location and online social networks
A novel set of location-based features for analyzing the social context of a geographic region, including location entropy, which measures the diversity of unique visitors of a location, are introduced. Expand
He says, she says: conflict and coordination in Wikipedia
The growth of non-direct work in Wikipedia is examined and the development of tools to characterize conflict and coordination costs in Wikipedia are described, which may inform the design of new collaborative knowledge systems. Expand
CrowdForge: crowdsourcing complex work
This work presents a general purpose framework for accomplishing complex and interdependent tasks using micro-task markets, a web-based prototype, and case studies on article writing, decision making, and science journalism that demonstrate the benefits and limitations of the approach. Expand
Power of the Few vs . Wisdom of the Crowd : Wikipedia and the Rise of the Bourgeoisie
Wikipedia has been a resounding success story as a collaborative system with a low cost of online participation. However, it is an open question whether the success of Wikipedia results from aExpand
An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets
Results suggest that intrinsic motivation can indeed improve the quality of workers’ output, confirming the hypothesis and finding a synergistic interaction between intrinsic and extrinsic motivators that runs contrary to previous literature suggesting “crowding out” effects. Expand
The Cognitive Atlas: Toward a Knowledge Foundation for Cognitive Neuroscience
A new open collaborative project is described that aims to provide a knowledge base for cognitive neuroscience, called the Cognitive Atlas, and how this project has the potential to drive novel discoveries about both mind and brain. Expand
Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work
Overall it is found that reverts are powerfully demotivating, but that their net influence is that more quality work is done in Wikipedia as a result of reverts than is lost by chasing editors away. Expand