Labeling images with a computer game

  title={Labeling images with a computer game},
  author={Luis von Ahn and Laura A. Dabbish},
  journal={Proceedings of the SIGCHI Conference on Human Factors in Computing Systems},
  • Luis von AhnLaura A. Dabbish
  • Published 25 April 2004
  • Computer Science
  • Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
We introduce a new interactive system: a game that is fun and can be used to create valuable output. When people play the game they help determine the contents of images by providing meaningful labels for them. If the game is played as much as popular online games, we estimate that most images on the Web can be labeled in a few months. Having proper labels associated with each image on the Web would allow for more accurate image search, improve the accessibility of sites (by providing… 

Figures from this paper

Designing Image Labeling Games For More Informative Tags

This thesis describes the design and implementation of two versions of the game Karido, a new image labeling game designed to collect more diverse tags, which are evaluated based on data collected during a three week trial deployment.

Improving accessibility of the web with a computer game

Phetch is an enjoyable computer game that collects explanatory descriptions of images, and is an example of a new class of games that provide entertainment in exchange for human processing power.

ClueMeIn: Obtaining More Specific Image Labels Through a Game

ClueMeIn is described, an entertaining web-based game with a purpose that generates more detailed image labels than the ESP Game, and how the results can lead to improvements in the accuracy of image searches over image labels generated by the ESP game when using the same public dataset.

Playing games as a way to improve automatic image annotation

A framework for image annotation that combines the benefits of three paradigms: automatic annotation, human intervention and entertainment activities is proposed and the ASAA (application for semi-automatic annotation) interface is described, a new computer game for image tagging.

Peekaboom: a game for locating objects in images

Peekaboom is an entertaining web-based game that can help computers locate objects in images and is an example of a new, emerging class of games, which not only bring people together for leisure purposes, but also exist to improve artificial intelligence.

Odd Leaf Out: Improving Visual Recognition with Games

  • Derek L. HansenD. Jacobs Eric Stevens
  • Computer Science
    2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing
  • 2011
A new game is introduced, Odd Leaf Out, which provides players with an enjoyable and educational game that serves the purpose of identifying misclassification errors in a large database of labeled leaf images.

An interactive framework for image annotation through gaming

This framework is able to assign (or derive) accurate tags for images by eliminating annotations made by a less-rational (cheater) player and integrates a number of different algorithms that are commonly found in image processing and game theoretic approaches to obtain an accurate label.

A Novel Algorithm for Improving the ESP Game

A new algorithm to use neglected data to generate new labels for the images using Recycle Unused Answers For Images algorithm (RUAI) is presented and the results reveal that the proposed algorithm improved the results in compared to the ESP game in all cases.

Improving Image Search with PHETCH

Phetch is presented, an engaging multiplayer game that allows people to attach accurate explanatory text captions to arbitrary images on the Web and collects valuable information that can be applied towards improving image retrieval.

ClueMeIn: Enhancing the ESP Game to Obtain More Specific Image Labels

ClueMeIn is introduced, an entertaining web-based game that uses a similar format to obtain more detailed image labels than the ESP game, and will improve the accuracy of image searches and better accessibility for the visually impaired.



Finding Naked People

A content-based retrieval strategy that can tell whether there are naked people present in an image and an effective mask for skin regions is demonstrated, which introduces a new view of object recognition.

PicASHOW: pictorial authority search by hyperlinks on the web

It is concluded that link analysis, a proven effective technique for Web page search, can improve the performance of Web image retrieval, as well as extend its definition to include the retrieval of image hubs and containers.

Clustering art

This work extends a recently developed method for learning the semantics of image databases using text and pictures and uses WordNet to provide semantic grouping information and to help disambiguate word senses, as well as emphasize the hierarchical nature of semantic relationships.

Learning the semantics of words and pictures

  • Kobus BarnardD. Forsyth
  • Computer Science
    Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001
  • 2001
The model is very promising for information retrieval tasks such as database browsing and searching for images based on text and/or image features, and can be used for novel applications such as associating words with pictures, and unsupervised learning for object recognition.

Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary

This work shows how to cluster words that individually are difficult to predict into clusters that can be predicted well, and cannot predict the distinction between train and locomotive using the current set of features, but can predict the underlying concept.

Object Detection Using the Statistics of Parts

A trainable object detector achieves reliable and efficient detection of human faces and passenger cars with out-of-plane rotation.

Open Mind Animals : Insuring the quality of data openly contributed over the World Wide Web

A system of software modules for automatically and semi-automatically preventing poor data from being accepted in Animals is implemented, which filters faulty data through a variety of mechanisms and leads to accurate decision tree classifiers.

Website Accessibility and the Private Sector: Disability Stakeholders Cannot Tolerate 2% Access!

DESIGNING WEBSITES FOR MAXIMUM MARKET PENETRATION Introduction and Problem Among website designers, the issue of website accessibility has become a very controversial topic. Because of poor design,