• Publications
  • Influence
Human computation tasks with global constraints
TLDR
We introduce a collaborative planning system called Mobi that illustrates a novel crowdware paradigm. Expand
  • 166
  • 12
  • PDF
Evaluation of Algorithms Using Games: The Case of Music Tagging
TLDR
We introduce a new method for evaluating audio tagging algorithms on a large scale by collecting set-level judgments from players of a human computation game called TagATune. Expand
  • 119
  • 12
  • PDF
Input-agreement: a new mechanism for collecting data using human computation games
TLDR
A new mechanism for collecting labeled data using "games with a purpose." In this mechanism, players are provided with either the same or a different object, and asked to describe that object to each other. Expand
  • 297
  • 10
  • PDF
TagATune: A Game for Music and Sound Annotation
TLDR
This paper presents the rationale and iterative design of a new game called TagATune, which elicits from human players descriptions of sounds and music (collectively referred to as tunes). Expand
  • 229
  • 9
  • PDF
Towards Large-Scale Collaborative Planning: Answering High-Level Search Queries Using Human Computation
TLDR
We introduce CrowdPlan, a human computation algorithm that takes as input a high-level mission and returns as output a simple plan that captures the important aspects of the user's problem. Expand
  • 39
  • 6
  • PDF
Crowdsourcing as a Tool for Research: Implications of Uncertainty
TLDR
This paper is not a philosophical or ethical discussion about the merits of crowdsourcing in academic research; instead, it serves as a formative study about researchers as potential users of crowdsourced systems. Expand
  • 41
  • 5
  • PDF
Human Computation for Attribute and Attribute Value Acquisition
We introduce a human computation approach for acquiring object attributes and attribute values from the crowd, including a new game called Polarity.
  • 21
  • 5
  • PDF
Toward Never Ending Language Learning
We report research toward a never-ending language learning system, focusing on a first implementation which learns to classify occurrences of noun phrases according to lexical categories such asExpand
  • 40
  • 4
  • PDF
Learning to Tag from Open Vocabulary Labels
TLDR
In this work, we present a new approach that organizes these noisy tags into well-behaved semantic classes using topic modeling, and learn to predict tags accurately using a mixture of topic classes. Expand
  • 37
  • 4
  • PDF
Human Computation
TLDR
This talk discusses a paradigm for utilizing human processing power to solve problems that computers cannot yet solve. Expand
  • 52
  • 3
  • PDF