Recovery of Missing Data in Correlated Smart Grid Datasets

  title={Recovery of Missing Data in Correlated Smart Grid Datasets},
  author={Cristian Genes and I{\~n}aki Esnaola and Samir Medina Perlaza and Daniel Coca},
  journal={2019 IEEE Data Science Workshop (DSW)},
We study the recovery of missing data from multiple smart grid datasets within a matrix completion framework. The datasets contain the electrical magnitudes required for monitoring and control of the electricity distribution system. Each dataset is described by a low rank matrix. Different datasets are correlated as a result of containing measurements of different physical magnitudes generated by the same distribution system. To assess the validity of matrix completion techniques in the… 

Figures from this paper

Positive Active Power Missing Value Repairing with LSTM Prediction

This paper proposes a method for repairing missing positive active power data based on the LSTM prediction model that has good theoretical and practical application value in repairing the missing of positive activePower data.

A Deduction Method of Segmented Switching Power Data Based on BP Neural Network

Line loss rate of power network is an important technical and economic index which can reflect the power industry, the missing data of power distribution network has a serious impact on the



Robust Recovery of Missing Data in Electricity Distribution Systems

An algorithm for recovering missing state variable observations in electricity distribution systems is presented that exploits the low rank structure of the state variables via a matrix completion approach incorporating prior knowledge in the form of second order statistics.

Novel matrix completion methods for missing data recovery in urban systems

A new recovery method that combines the optimality of the Bayesian estimation with the matrix completion-based recovery is proposed and numerical analysis shows that the proposed algorithm outperforms the standard matrix-completion based recovery in various noise and sampling regimes within the joint recovery setting.

Recovering missing data via matrix completion in electricity distribution systems

Numerical results show that matrix completion based recovery outperforms MMSE estimator when the number of available observations is low and access to perfect source statistics is not available.

Missing Data Recovery by Exploiting Low-Dimensionality in Power System Synchrophasor Measurements

This paper presents a new framework of recovering missing synchrophasor measurements (erasures). Leveraging the approximate low-rank property of phasor measurement unit (PMU) data, we connect the

Information-theoretic attacks in the smart grid

Gaussian random attacks that jointly minimize the amount of information obtained by the operator from the grid and the probability of attack detection are presented. The construction of the attack is

Malicious Data Attacks on the Smart Grid

Malicious attacks against power systems are investigated, in which an adversary controls a set of meters and is able to alter the measurements from those meters, and an optimal attack based on minimum energy leakage is proposed.

False data injection attacks against state estimation in electric power grids

A new class of attacks, called false data injection attacks, against state estimation in electric power grids are presented, showing that an attacker can exploit the configuration of a power system to launch such attacks to successfully introduce arbitrary errors into certain state variables while bypassing existing techniques for bad measurement detection.

Machine Learning Methods for Attack Detection in the Smart Grid

Experimental analyses show that machine learning algorithms can detect attacks with performances higher than attack detection algorithms that employ state vector estimation methods in the proposed attack detection framework.

The internet of energy: a web-enabled smart grid system

The use of small, cheap, and resource-constrained devices with pervasive computing capabilities as the key component to deploy a ubiquitous energy control system is advocated, making the Internet-based smart grid vision considered in this article practically achievable in the not too distant future.

Matrix Completion With Noise

This paper surveys the novel literature on matrix completion and introduces novel results showing that matrix completion is provably accurate even when the few observed entries are corrupted with a small amount of noise, and shows that, in practice, nuclear-norm minimization accurately fills in the many missing entries of large low-rank matrices from just a few noisy samples.