• Corpus ID: 246275932

A deep mixture density network for outlier-corrected interpolation of crowd-sourced weather data

@article{Kirkwood2022ADM,
  title={A deep mixture density network for outlier-corrected interpolation of crowd-sourced weather data},
  author={Charlie Kirkwood and Theodoros Economou and Henry M. Odbert and Nicolas Pugeault},
  journal={ArXiv},
  year={2022},
  volume={abs/2201.10544}
}
As the costs of sensors and associated IT infrastructure decreases — as exemplified by the Internet of Things — increasing volumes of observational data are becoming available for use by environmental scientists. However, as the number of available observation sites increases, so too does the opportunity for data quality issues to emerge, particularly given that many of these sensors do not have the benefit of official maintenance teams. To realise the value of crowd sourced ‘Internet of Things… 

References

SHOWING 1-10 OF 41 REFERENCES
Development and Application of a Statistically-Based Quality Control for Crowdsourced Air Temperature Data
TLDR
In this study, a statistically-based quality control (QC) is developed to identify suspicious air temperature (T) measurements from crowdsourced data sets, and the transferability of the newly developed QC and the use of CWS data is illustrated.
Deep covariate-learning: optimising information extraction from terrain texture for geostatistical modelling applications
TLDR
A deep learning approach to automatically deriving optimal task-specific terrain texture covariates from a standard SRTM 90m gridded digital elevation model (DEM) is presented, finding that this approach produces covariates for geostatistical modelling that have surprisingly strong explanatory power on their own.
Can the crowdsourcing data paradigm take atmospheric science to a new level? A case study of the urban heat island of London quantified using Netatmo weather stations
Crowdsourcing techniques are frequently used across science to supplement traditional means of data collection. Although atmospheric science has so far been slow to harness the technology,
Outlier detection in sensed data using statistical learning models for IoT
TLDR
An IoT architecture to detect the occurrence of both Error and Event in a forest environment with the help of four statistical models, i.e., Classification and Regression Trees (CART), Random Forest (RF), Gradient Boosting Machine (GBM) and Linear Discriminant Analysis (LDA).
Bayesian Inference for Large Scale Image Classification
TLDR
ATMC, an adaptive noise MCMC algorithm that estimates and is able to sample from the posterior of a neural network, is introduced and is shown to be intrinsically robust to overfitting on the training data and to provide a better calibrated measure of uncertainty compared to the optimization baseline.
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning
TLDR
A new theoretical framework is developed casting dropout training in deep neural networks (NNs) as approximate Bayesian inference in deep Gaussian processes, which mitigates the problem of representing uncertainty in deep learning without sacrificing either computational complexity or test accuracy.
Outlier detection approaches for wireless sensor networks: A survey
Progress in Outlier Detection Techniques: A Survey
TLDR
This survey presents a comprehensive and organized review of the progress of outlier detection methods from 2000 to 2019 and categorizes them into different techniques from diverse outlier Detection techniques, such as distance-, clustering-, density-, ensemble-, and learning-based methods.
Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks
TLDR
Practical techniques based on Gaussian approximations for implementation of these powerful methods for controlling, comparing and using adaptive networks are described.
...
...