Geotagging in multimedia and computer vision—a survey

  title={Geotagging in multimedia and computer vision—a survey},
  author={Jiebo Luo and Dhiraj Joshi and Jie Yu and Andrew C. Gallagher},
  journal={Multimedia Tools and Applications},
Geo-tagging is a fast-emerging trend in digital photography and community photo sharing. The presence of geographically relevant metadata with images and videos has opened up interesting research avenues within the multimedia and computer vision domains. In this paper, we survey geo-tagging related research within the context of multimedia and along three dimensions: (1) Modalities in which geographical information can be extracted, (2) Applications that can benefit from the use of geographical… 

Geo-tagging online videos using semantic expansion and visual analysis

A bimodal geo-tagging system for online videos based on extracting and expanding the geographical information contained in the textual metadata and on visual similarity criteria is presented.

A Survey of Geo-tagged Multimedia Content Analysis within Flickr

The role of information retrieval, integration and extraction from the technical point of view, coupled together with human social network activities, like, for instance, localization and recommendations based on pre-processed collaborative geo-tagged photos, resulting into more efficient, optimized search results is explored.

Large Scale Image Retrieval for Location Estimation

The research reported in this thesis investigates how to automatically derive geo-information from multimedia content and focuses on the challenge of estimating the geo-coordinates of the location of an image solely on the basis of its visual content.

Retrieving geo-location of videos with a divide & conquer hierarchical multimodal approach

This paper presents a strategy to identify the geographic location of videos that relies on a multi-modal cascade pipeline that exploits the available sources of information, namely the user's upload history, his social network and a visual-based matching technique to better exploit the tags associated with the input video.

Large-Scale Visual Geo-Localization

This timely and authoritative volume explores the bidirectional relationship between images and locations. The text presents a comprehensive review of the state of the art in large-scale visual

A visual approach for video geocoding using bag-of-scenes

Despite the very simple way to generate the visual dictionary, which has taken photos at random, the results show that the approach presents high accuracy relative to the state-of-the art solutions.

Placing Photos with a Multimodal Probability Density Function

A general model for effectively using both textual metadata and visual features of photos to automatically place them on a world map with state-of-the-art performance is presented.

A Unified Geolocation Framework for Web Videos

This article analyzes different social, visual, and textual relationships from a real-world dataset and finds four relationships with apparent geography clues that can be used for web video geolocation.

Finding Social Points of Interest from Georeferenced and Oriented Online Photographs

This work proposes a novel method for the automatic localization of points of interest depicted in photos taken by people across the world, which exploits the geographic coordinates and the compass direction supplied by modern cameras, while accounting for possible measurement errors due to the variability in accuracy of the sensors that produced them.

Automatic Geotagging for Personal Photos with Sharing Images on Social Media Networks

The results show that geographical coordinates are the most influential component for resolving geo-location and the geotagging process using sharing photos on social media service is revealed and discussed.



Relevance ranking in georeferenced video search

This study investigates and presents three ranking algorithms that use spatial and temporal properties of georeferenced videos to effectively rank search results and introduces a histogram-based approach that allows fast online computations.

Viewable scene modeling for geospatial video search

An estimation model of the viewable area of a scene for indexing and searching and reports on a prototype implementation of a novel approach for querying videos based on the notion that the geographical location of the captured scene in addition to the location of a camera can provide valuable information and may be used as a search criterion in many applications.

Beyond GPS: determining the camera viewing direction of a geotagged image

This work utilizes both Google Street View and Google Earth satellite images to produce more precise location information, i.e. the viewing direction for geotagged photos, and proposes a two-pronged system for visual matching and near-orthogonal view matching.

Mapping the world's photos

This work uses the spatial distribution of where people take photos to define a relational structure between the photos that are taken at popular places, and finds that visual and temporal features improve the ability to estimate the location of a photo, compared to using just textual features.

Geo-located image analysis using latent representations

A statistical method for geo-located image categorization is presented, in which categories are formed by clustering geographically proximal images with similar visual appearance, which permits also to deal with the geo-recognition problem, i.e., to infer the geographical area depicted by images with no available location information.

Global annotation on georeferenced photographs

An efficient world-scale system for providing automatic annotation on collections of geo-referenced photos that fuses geographic and visual information to provide annotations for uploaded photographs taken anywhere in the world in a matter of seconds.

Hierarchical photo organization using geo-relevance

A novel framework for organizing large collections of images in a hierarchical way, based on scene semantics, using images to score the scene in order to identify typical views and important locations which are termed Geo-Relevance.

MonuAnno: automatic annotation of georeferenced landmarks images

A new automatic technique for annotating landmarks images, very frequent among tourism pictures, is proposed and the results show that the precision of the labeling process in MonuAnno exceeds 80%, when annotating around 50% of the images in the test set.

Leveraging probabilistic season and location context models for scene understanding

Experimental results show that incorporating the season and location context significantly improves the performance of region recognition and is fused using a probabilistic graphical model to improve the accuracy of object region recognition.

Detecting cultural differences using consumer-generated geotagged photos

A novel method to detect cultural differences over the world automatically by using a large amount of geotagged images on the photo sharing Web sites such as Flickr, using the state-of-the-art object recognition technique to mine representative photos of the given concept from a large-scale unorganized collection of consumer-generated geot tagged photos.