A realistic evaluation of indoor positioning systems based on Wi-Fi fingerprinting: The 2015 EvAAL-ETRI competition
@article{TorresSospedra2017ARE, title={A realistic evaluation of indoor positioning systems based on Wi-Fi fingerprinting: The 2015 EvAAL-ETRI competition}, author={Joaqu{\'i}n Torres-Sospedra and Adriano J. C. Moreira and Stefan Knauth and Rafael Berkvens and Ra{\'u}l Montoliu and {\'O}scar Belmonte and Sergi Trilles and Maria Jo{\~a}o Nicolau and Filipe Meneses and Ant{\'o}nio D. Costa and Athanasios Koukofikis and Maarten Weyn and Herbert Peremans}, journal={J. Ambient Intell. Smart Environ.}, year={2017}, volume={9}, pages={263-279} }
This paper presents results from comparing different Wi-Fi fingerprinting algorithms on the same private dataset. The algorithms where realized by independent teams in the frame of the off-site track of the EvAAL-ETRI Indoor Localization Competition which was part of the Sixth International Conference on Indoor Positioning and Indoor Navigation (IPIN 2015). Competitors designed and validated their algorithms against the publicly available UJIIndoorLoc database which contains a huge referenceand…
42 Citations
Machine Learning applied to Wi-Fi fingerprinting: The experiences of the Ubiqum Challenge
- Computer Science2019 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2019
The results show that state-of-art Machine Learning methods provide good positioning results, but expertise on the problem is still needed.
A Comprehensive and Reproducible Comparison of Clustering and Optimization Rules in Wi-Fi Fingerprinting
- Computer ScienceIEEE Transactions on Mobile Computing
- 2022
A comprehensive comparative study of existing methods to reduce the complexity and size of the radio map used at the operational stage and introduces a new evaluation framework with multiple datasets, aiming at getting more general results and contributing to a better reproducibility of new proposed solutions in the future.
Analysis of Sources of Large Positioning Errors in Deterministic Fingerprinting
- Computer ScienceSensors
- 2017
This paper investigates why large positioning errors occur in Wi-Fi fingerprinting and how to detect them by using the received signal strength intensities.
Comparing the Performance of Indoor Localization Systems through the EvAAL Framework
- Computer ScienceSensors
- 2017
The general lines of the EvAAL benchmarking framework are introduced, aimed at a fair comparison of indoor positioning systems through a challenging competition under complex, realistic conditions, and shows how it was used in the 2016 IPIN Competition.
IndoorLoc platform: A public repository for comparing and evaluating indoor positioning systems
- Computer Science2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2017
The proposed web platform can be used to download datasets, learn how some well-known algorithms work, study the implementation of those algorithms, test the methods, and even upload indoor positioning estimations of the user's methods to check the accuracy when comparing against the results provided by other methods already included in a ranking.
Wi-Fi Crowdsourced Fingerprinting Dataset for Indoor Positioning
- Computer ScienceData
- 2017
A new openly available Wi-Fi fingerprint dataset, comprised of 4648 fingerprints collected with 21 devices in a university building in Tampere, Finland, is presented and some benchmark indoor positioning results using these data are presented.
Indoor Fingerprint Positioning Based on Wi-Fi: An Overview
- Computer ScienceISPRS Int. J. Geo Inf.
- 2017
An overview of indoor fingerprint positioning based on Wi-Fi is provided and it is hoped that this research will serve as a stepping stone for those interested in advancing indoor positioning.
Ensembling Multiple Radio Maps with Dynamic Noise in Fingerprint-based Indoor Positioning
- Computer Science2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring)
- 2021
A novel approach to add random noise to the radio map which will be used in combination with an ensemble model to improve the baseline method results in around 10% on average.
IndoorLoc Platform: A Web Tool to Support the Comparison of Indoor Positioning Systems
- Computer ScienceGeographical and Fingerprinting Data to Create Systems for Indoor Positioning and Indoor/Outdoor Navigation
- 2019
The Smartphone-Based Offline Indoor Location Competition at IPIN 2016: Analysis and Future Work
- Computer ScienceSensors
- 2017
The competition permits a coherent evaluation method of the competitors’ estimations, where inside information to fine-tune their systems is not offered, and thus provides a good starting point to introduce a fair comparison between the smartphone-based systems found in the literature.
References
SHOWING 1-10 OF 80 REFERENCES
Wi-Fi fingerprinting in the real world - RTLS@UM at the EvAAL competition
- Computer Science2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2015
The experience of the RTLS@UM team in participating in track 3 of the EvAAL competition is described, which describes the performance, in the real world, of the several existing solutions based on Wi-Fi fingerprinting.
Comprehensive analysis of distance and similarity measures for Wi-Fi fingerprinting indoor positioning systems
- Computer ScienceExpert Syst. Appl.
- 2015
Combining similarity functions and majority rules for multi-building, multi-floor, WiFi positioning
- Computer Science2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2012
The proposed fingerprint method uses a previously stored map of the signal strength at several positions and determines the position using similarity functions and majority rules, and compares different similarity functions to understand their impact on the accuracy of the positioning system.
Wi-Fi multi-floor indoor positioning considering architectural aspects and controlled computational complexity
- Computer ScienceExpert Syst. Appl.
- 2014
Platform for benchmarking of RF-based indoor localization solutions
- Computer ScienceIEEE Communications Magazine
- 2015
The EVARILOS Benchmarking Platform is presented, which enables automated evaluation and comparison of multiple solutions in different environments using multiple evaluation metrics, and demonstrates the need for objective evaluation methods that consider multiple evaluation criteria inDifferent environments.
Efficient Techniques and Algorithms for Improving Indoor Localization Precision on WLAN Networks Applications
- Computer ScienceInt. J. Commun. Netw. Syst. Sci.
- 2009
This paper compares the use of radio frequency power levels and relative time delays based on ray-tracing as detection methods to estimate the localization of a set of mobile station using the fingerprint technique and shows that more precision can be obtained in the localization process by means of relative delay instead of RF power detection method.
Fingerprint calibrated centroid and scalar product correlation RSSI positioning in large environments
- Computer Science2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2015
The design and result of a fingerprint calibrated weighted centroid localization (FCWC) algorithm is outlined, discussed and evaluated against the UJIIndoorLoc data set and a scalar product correlation fingerprinting (SPCF) algorithm has been implemented.
Influence of human absorption of Wi-Fi signal in indoor positioning with Wi-Fi fingerprinting
- Computer Science2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2015
For outdoors, Global Network Navigation Systems have become the standard mechanism of positioning; but for indoor environments, there is still no standard system. Several mechanisms have been…
A survey of experimental evaluation in indoor localization research
- Computer Science2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN)
- 2015
This work looks at the articles published in the proceedings of IPIN by IEEE Xplore from 2010 to 2014, and analyzes the development of evaluation methods.
Device self-calibration in location systems using signal strength histograms
- Computer ScienceJ. Locat. Based Serv.
- 2013
This work proposes a self-calibration method that attains a good mapping between the reference and user devices using RSS histograms and indicates that it is more robust to device diversity compared with other calibration methods in the literature.