Placing Images with Refined Language Models and Similarity Search with PCA-reduced VGG Features
@inproceedings{KordopatisZilos2016PlacingIW, title={Placing Images with Refined Language Models and Similarity Search with PCA-reduced VGG Features}, author={Giorgos Kordopatis-Zilos and Adrian Daniel Popescu and Symeon Papadopoulos and Yiannis Kompatsiaris}, booktitle={MediaEval Benchmarking Initiative for Multimedia Evaluation}, year={2016} }
We describe the participation of the CERTH/CEA-LIST team in the MediaEval 2016 Placing Task. We submitted five runs to the estimation-based sub-task: one based only on text by employing a Language Model-based approach with several refinements, one based on visual content, using geospatial clustering over the most visually similar images, and three based on a hybrid scheme exploiting both visual and textual cues from the multimedia items, trained on datasets of different size and origin. The…
8 Citations
Leveraging EfficientNet and Contrastive Learning for Accurate Global-scale Location Estimation
- Computer ScienceICMR
- 2021
This paper addresses the problem of global-scale image geolocation by proposing a mixed classification-retrieval scheme that leverages the EfficientNet architecture and introduces a new residual architecture that is trained with contrastive learning to map input images to an embedding space that minimizes the pairwise geodesic distance of same-location images.
MM-Locate-News: Multimodal Focus Location Estimation in News
- Computer ScienceArXiv
- 2022
A novel dataset called Multimodal Focus Location of News (MM-Locate-News) is introduced and state-of-the-art methods on the new benchmark dataset are evaluated and novel models to predict the focus location of news using both textual and image content are suggested.
A Transformer-based Framework for POI-level Social Post Geolocation
- Computer ScienceArXiv
- 2022
A transformer-based general framework is presented, which builds upon pre-trained language models and considers non-textual data, for social post geolocation at the POI level and demonstrates that three variants of the proposed framework outperform multiple state-of-art baselines in terms of accuracy and distance error metrics.
Geotagging Text Content With Language Models and Feature Mining
- Computer ScienceProceedings of the IEEE
- 2017
This work presents a highly accurate geotagging approach for estimating the locations alluded by text annotations based on refined language models that are learned from massive corpora of social media annotations, and demonstrates the consistently superior geotagged accuracy and low median distance error of the proposed approach.
Leveraging Selective Prediction for Reliable Image Geolocation
- Computer ScienceMMM
- 2022
This paper proposes two novel selection functions that leverage the output probability distributions of geolocation models to infer localizability at different scales, and benchmarked against the most widely used selective prediction baselines, outperforming them in all cases.
Location Extraction from Social Media
- Computer ScienceACM Trans. Inf. Syst.
- 2018
Five “best-of-class” location extraction algorithms are evaluated using an OpenStreetMap database and a language model constructed from social media tags and multiple gazetteers, and a detailed failure analysis for the approaches is performed.
Knowledge-based and data-driven approaches for geographical information access
- Computer Science
- 2017
This thesis attempts to improve the effectiveness results of GeoIA tasks by improving the detection, understanding, and use of a part of the geographical and the thematic content of queries and documents with Toponym Recognition, Toponym Disambiguation and Natural Language Processing (NLP) techniques.
Extracting localized information from a Twitter corpus for flood prevention
- Computer ScienceArXiv
- 2019
The goal here is to get a first estimation of the quality and precision of the geographical information featured in the collected corpus, as well as its analysis from both spatial and topical perspectives.
References
SHOWING 1-10 OF 10 REFERENCES
CERTH/CEA LIST at MediaEval Placing Task 2015
- Computer ScienceMediaEval
- 2015
The participation of the CERTH/CEA LIST team in the Placing Task of MediaEval 2015 is described, with the best results obtained when both visual and textual features are combined, using external data for training.
CEA LIST's Participation at MediaEval 2013 Placing Task
- Computer ScienceMediaEval
- 2013
Results show that all modifications proposed this year have a positive effect, and a “standard” based only on the training data (cues (1)+(2)) has the poorest performance.
Scalable domain adaptation of convolutional neural networks
- Computer ScienceArXiv
- 2015
Convolutional neural networks (CNNs) tend to become a standard approach to solve a wide array of computer vision problems. Besides important theoretical and practical advances in their design, their…
Finding locations of flickr resources using language models and similarity search
- Computer ScienceICMR '11
- 2011
A two-step approach to estimate where a given photo or video was taken, using only the tags that a user has assigned to it, to improve substantially over either language models or similarity search alone.
Very Deep Convolutional Networks for Large-Scale Image Recognition
- Computer ScienceICLR
- 2015
This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
In-depth Exploration of Geotagging Performance using Sampling Strategies on YFCC100M
- Computer ScienceMMCommons @ ACM Multimedia
- 2016
This paper proposes an evaluation methodology based on an array of sampling strategies over a reference test collection, and a way of quantifying and summarizing the volatility of performance measurements, and demonstrates that the proposed methodology could help capture the performance of geotagging systems in a comprehensive manner that is complementary to existing evaluation approaches.
The New Data and New Challenges in Multimedia Research
- Computer ScienceArXiv
- 2015
The rationale behind the creation of the YFCC100M, the largest public multimedia collection that has ever been released, is explained, as well as the implications the dataset has for science, research, engineering, and development.
Geotagging Social Media Content with a Refined Language Modelling Approach
- Computer SciencePAISI
- 2015
A new geotagging approach is presented that can estimate the location of a post based on its text using refined language models that are learned from massive corpora of social media content.
The Placing Task at MediaEval 2015
- Computer ScienceMediaEval
- 2015
The sixth edition of the Placing Task at MediaEval introduces two new sub-tasks: (1) locale-based placing, which emphasizes the need to move away from an evaluation purely based on latitude and…
The new data and new challenges in multimedia research. CoRR, abs
- The new data and new challenges in multimedia research. CoRR, abs
- 1503