Automatic Image Tagging Using Community-Driven Online Image Databases

  title={Automatic Image Tagging Using Community-Driven Online Image Databases},
  author={Marius Renn and Joost van Beusekom and Daniel Keysers and Thomas M. Breuel},
  booktitle={Adaptive Multimedia Retrieval},
Automatic image tagging is becoming increasingly important to organize large amounts of image data. To identify concepts in images, these tagging systems rely on large sets of annotated image training sets. In this work we analyze image sets taken from online community-driven image databases, such as Flickr, for use in concept identification. Real-world performance is measured using our flexible tagging system, Tagr. 
Learning Visual Contexts for Image Annotation From Flickr Groups
An extension of automatic image annotation that takes the context of a picture into account, based on the core assumption that users group their pictures into batches, whereas the images within a batch are likely to have a common style.
Semantic Retrieval of Images by Learning from Wikipedia
A novel integration into a Semantic Desktop and the usage of Wikipedia is proposed to address the common problem of initial knowledge acquisition and improvement of the performance.
Generic and Specific Object Recognition for Semantic Retrieval of Images
A system automatically adapted to the user's needs, providing useful annotations is proposed, utilizing Wikipedia to learn instances and abstract classes and achieves practical recognition rates of 26% on specific instance and 64% on abstract class level.
Automatic Shape Annotation Using Rough Sets and Decision Trees
Annotation of images automatically assigns tags to images by analyzing contents of images. Shape is the most important feature of images, by using this features tagging of images is possible, can be
Enhanced image retrieval using spatial information and ontologies
New approaches for enhancing image annotation and retrieval by capturing spatial relationships between labelled objects in images are developed and the approach is shown to be capable of handling effectively a wide range of queries requiring spatial information and the assertions made by the system are shows to be broadly in line with human perceptions.
An interactive framework for image annotation through gaming
This framework is able to assign (or derive) accurate tags for images by eliminating annotations made by a less-rational (cheater) player and integrates a number of different algorithms that are commonly found in image processing and game theoretic approaches to obtain an accurate label.
The aware toolbox for the detection of law infringements on web pages
The analysis technologies, ranging from text based information extraction, over optical character recognition and phonetic fuzzy string matching to a set of image analysis and retrieval tools; as well as the scripting language to define the analysis flow are described.


Automatic image annotation and retrieval using cross-media relevance models
The approach shows the usefulness of using formal information retrieval models for the task of image annotation and retrieval by assuming that regions in an image can be described using a small vocabulary of blobs.
Exploiting ontologies for automatic image annotation
The paper proposes methods to use a hierarchy defined on the annotation words derived from a text ontology to improve automatic image annotation and retrieval and demonstrates improvements in the annotation performance of translation models.
Automated Image Annotation Using Global Features and Robust Nonparametric Density Estimation
It is shown that under this framework quite simple image properties such as global colour and texture distributions provide a strong basis for reliably annotating images.
Semi-Automatic Image Annotation
A novel approach to semi-automatically and progressively annotating images with keywords is presented, and a preliminary user study is described showing that users view annotations as important and will likely use them in image retrieval.
Real-Time Computerized Annotation of Pictures
  • Jia Li, James Ze Wang
  • Computer Science
    IEEE Transactions on Pattern Analysis and Machine Intelligence
  • 2008
New optimization and estimation techniques to address two fundamental problems in machine learning are developed that serve as the basis for the automatic linguistic indexing of pictures - real time (ALIPR) system of fully automatic and high-speed annotation for online pictures.
Learning the semantics of words and pictures
  • Kobus Barnard, D. Forsyth
  • Computer Science
    Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001
  • 2001
The model is very promising for information retrieval tasks such as database browsing and searching for images based on text and/or image features, and can be used for novel applications such as associating words with pictures, and unsupervised learning for object recognition.
FIRE - Flexible Image Retrieval Engine: ImageCLEF 2004 Evaluation
Fire, a content-based image retrieval system, is described, which uses the image content alone and obtained the best result in the category “only visual features, fully automatic retrieval” in the medical retrieval task.
Matching Words and Pictures
A new approach for modeling multi-modal data sets, focusing on the specific case of segmented images with associated text, is presented, and a number of models for the joint distribution of image regions and words are developed, including several which explicitly learn the correspondence between regions and Words.
Image and Video Retrieval
The main research topics in multimedia content analysis are summarized, some assumptions are state and the main future trends including usage of long term memory, context, dynamic processing, evolvable generalized detectors and user aspects are postulated.
Color indexing with weak spatial constraints
This work proposes an approach that lies between uniformly tesselating the images with rectangular regions and relying on fully segmented images, and encoding a minimal amount of spatial information in the index to improve the discrimination power of color indexing techniques.