Physics-informed Evolutionary Strategy based Control for Mitigating Delayed Voltage Recovery

  title={Physics-informed Evolutionary Strategy based Control for Mitigating Delayed Voltage Recovery},
  author={Yan Du and Qiuhua Huang and Renke Huang and Tianzhixi Yin and Jie Tan and Wenhao Yu and Xinya Li},
  journal={IEEE Transactions on Power Systems},
In this work we propose a novel data-driven, realtime power system voltage control method based on the physicsinformed guided meta evolutionary strategy (ES). The main objective is to quickly provide an adaptive control strategy to mitigate the fault-induced delayed voltage recovery (FIDVR) problem. Reinforcement learning methods have been developed for the same or similar challenging control problems, but they suffer from training inefficiency and lack of robustness for “corner or unseen… 


Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning
Fast adaptation of the meta-trained DRL polices with latent variables to new operating conditions and scenarios using the proposed DMRL algorithm achieve superior performance compared to the state-of-the-art DRL and model predictive control (MPC) methods.
Accelerated Derivative-free Deep Reinforcement Learning for Large-scale Grid Emergency Voltage Control
Test results show that, compared to other methods including model-predictive control (MPC) and proximal policy optimization(PPO) methods, PARS shows better computational efficiency, more robustness in learning, excellent scalability and generalization capability.
Adaptive Power System Emergency Control Using Deep Reinforcement Learning
An open-source platform named Reinforcement Learning for Grid Control (RLGC) has been designed for the first time to assist the development and benchmarking of DRL algorithms for power system control.
A Model-Free Voltage Control Approach to Mitigate Motor Stalling and FIDVR for Smart Grids
This work focuses on fault-induced delayed voltage recovery (FIDVR) events, which require complex and accurate dynamic load models to replicate such events, and utilizes MFC as an online controller to achieve the desired voltage stability under the FIDVR event.
Deep Reinforcement Learning-Based Approach for Proportional Resonance Power System Stabilizer to Prevent Ultra-Low-Frequency Oscillations
A high-order polynomial structure to replace the CPSS, and combine it with a proportional resonance controller to form a novel PR-PSS is proposed, and a deep reinforcement learning (DRL) algorithm asynchronous advantage actor-critic (A3C) is introduced to train an agent.
Data-Driven Load Frequency Control for Stochastic Power Systems: A Deep Reinforcement Learning Method With Continuous Action Search
This letter proposes a data-driven, model-free method for load frequency control (LFC) against renewable energy uncertainties based on deep reinforcement learning (DRL) in continuous action domain.
Load Shedding Scheme with Deep Reinforcement Learning to Improve Short-term Voltage Stability
In this paper, a novel load shedding scheme against voltage instability with deep reinforcement learning (DRL). The convolutional neural networks (CNNs) are chosen to automatically learn the features
Evolution Strategies as a Scalable Alternative to Reinforcement Learning
This work explores the use of Evolution Strategies (ES), a class of black box optimization algorithms, as an alternative to popular MDP-based RL techniques such as Q-learning and Policy Gradients, and highlights several advantages of ES as a blackbox optimization technique.
Agent-Based Modeling in Electricity Market Using Deep Deterministic Policy Gradient Algorithm
Deep deterministic policy gradient algorithm is adopted to model the bidding strategies of generation companies and can intuitively reflect the different tacit collusion level by quantitatively adjusting GenCos’ patience parameter, which can be an effective means to analyze market strategies.
A Novel Online Load Shedding Strategy for Mitigating Fault-Induced Delayed Voltage Recovery
This paper develops a novel online fast load shedding strategy aimed at shedding the most effective load to mitigate fault-induced delayed voltage recovery (FIDVR). Induction motor kinetic energy