A realistic evaluation of indoor positioning systems based on Wi-Fi fingerprinting: The 2015 EvAAL-ETRI competition

@article{TorresSospedra2017ARE,
  title={A realistic evaluation of indoor positioning systems based on Wi-Fi fingerprinting: The 2015 EvAAL-ETRI competition},
  author={Joaqu{\'i}n Torres-Sospedra and Adriano J. C. Moreira and Stefan Knauth and Rafael Berkvens and Ra{\'u}l Montoliu and {\'O}scar Belmonte and Sergi Trilles and Maria Jo{\~a}o Nicolau and Filipe Meneses and Ant{\'o}nio D. Costa and Athanasios Koukofikis and Maarten Weyn and Herbert Peremans},
  journal={J. Ambient Intell. Smart Environ.},
  year={2017},
  volume={9},
  pages={263-279}
}
This paper presents results from comparing different Wi-Fi fingerprinting algorithms on the same private dataset. The algorithms where realized by independent teams in the frame of the off-site track of the EvAAL-ETRI Indoor Localization Competition which was part of the Sixth International Conference on Indoor Positioning and Indoor Navigation (IPIN 2015). Competitors designed and validated their algorithms against the publicly available UJIIndoorLoc database which contains a huge referenceand… 
View PDF
42 Citations
Highly Influential Citations
2
Background Citations
9
Methods Citations
13

Figures and Tables from this paper

42 Citations

Machine Learning applied to Wi-Fi fingerprinting: The experiences of the Ubiqum Challenge

The results show that state-of-art Machine Learning methods provide good positioning results, but expertise on the problem is still needed.

A Comprehensive and Reproducible Comparison of Clustering and Optimization Rules in Wi-Fi Fingerprinting

A comprehensive comparative study of existing methods to reduce the complexity and size of the radio map used at the operational stage and introduces a new evaluation framework with multiple datasets, aiming at getting more general results and contributing to a better reproducibility of new proposed solutions in the future.

Analysis of Sources of Large Positioning Errors in Deterministic Fingerprinting

This paper investigates why large positioning errors occur in Wi-Fi fingerprinting and how to detect them by using the received signal strength intensities.

Comparing the Performance of Indoor Localization Systems through the EvAAL Framework

The general lines of the EvAAL benchmarking framework are introduced, aimed at a fair comparison of indoor positioning systems through a challenging competition under complex, realistic conditions, and shows how it was used in the 2016 IPIN Competition.

IndoorLoc platform: A public repository for comparing and evaluating indoor positioning systems

The proposed web platform can be used to download datasets, learn how some well-known algorithms work, study the implementation of those algorithms, test the methods, and even upload indoor positioning estimations of the user's methods to check the accuracy when comparing against the results provided by other methods already included in a ranking.

Wi-Fi Crowdsourced Fingerprinting Dataset for Indoor Positioning

A new openly available Wi-Fi fingerprint dataset, comprised of 4648 fingerprints collected with 21 devices in a university building in Tampere, Finland, is presented and some benchmark indoor positioning results using these data are presented.

Indoor Fingerprint Positioning Based on Wi-Fi: An Overview

An overview of indoor fingerprint positioning based on Wi-Fi is provided and it is hoped that this research will serve as a stepping stone for those interested in advancing indoor positioning.

Ensembling Multiple Radio Maps with Dynamic Noise in Fingerprint-based Indoor Positioning

A novel approach to add random noise to the radio map which will be used in combination with an ensemble model to improve the baseline method results in around 10% on average.

IndoorLoc Platform: A Web Tool to Support the Comparison of Indoor Positioning Systems

The Smartphone-Based Offline Indoor Location Competition at IPIN 2016: Analysis and Future Work

The competition permits a coherent evaluation method of the competitors’ estimations, where inside information to fine-tune their systems is not offered, and thus provides a good starting point to introduce a fair comparison between the smartphone-based systems found in the literature.

References

SHOWING 1-10 OF 80 REFERENCES

Wi-Fi fingerprinting in the real world - RTLS@UM at the EvAAL competition

The experience of the RTLS@UM team in participating in track 3 of the EvAAL competition is described, which describes the performance, in the real world, of the several existing solutions based on Wi-Fi fingerprinting.

Comprehensive analysis of distance and similarity measures for Wi-Fi fingerprinting indoor positioning systems

Combining similarity functions and majority rules for multi-building, multi-floor, WiFi positioning

The proposed fingerprint method uses a previously stored map of the signal strength at several positions and determines the position using similarity functions and majority rules, and compares different similarity functions to understand their impact on the accuracy of the positioning system.

Wi-Fi multi-floor indoor positioning considering architectural aspects and controlled computational complexity

Platform for benchmarking of RF-based indoor localization solutions

The EVARILOS Benchmarking Platform is presented, which enables automated evaluation and comparison of multiple solutions in different environments using multiple evaluation metrics, and demonstrates the need for objective evaluation methods that consider multiple evaluation criteria inDifferent environments.

Efficient Techniques and Algorithms for Improving Indoor Localization Precision on WLAN Networks Applications

This paper compares the use of radio frequency power levels and relative time delays based on ray-tracing as detection methods to estimate the localization of a set of mobile station using the fingerprint technique and shows that more precision can be obtained in the localization process by means of relative delay instead of RF power detection method.

Fingerprint calibrated centroid and scalar product correlation RSSI positioning in large environments

The design and result of a fingerprint calibrated weighted centroid localization (FCWC) algorithm is outlined, discussed and evaluated against the UJIIndoorLoc data set and a scalar product correlation fingerprinting (SPCF) algorithm has been implemented.

Influence of human absorption of Wi-Fi signal in indoor positioning with Wi-Fi fingerprinting

For outdoors, Global Network Navigation Systems have become the standard mechanism of positioning; but for indoor environments, there is still no standard system. Several mechanisms have been…

A survey of experimental evaluation in indoor localization research

This work looks at the articles published in the proceedings of IPIN by IEEE Xplore from 2010 to 2014, and analyzes the development of evaluation methods.

Device self-calibration in location systems using signal strength histograms

This work proposes a self-calibration method that attains a good mapping between the reference and user devices using RSS histograms and indicates that it is more robust to device diversity compared with other calibration methods in the literature.
...