• Corpus ID: 219176657

Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning

  title={Distributed Voltage Regulation of Active Distribution System Based on Enhanced Multi-agent Deep Reinforcement Learning},
  author={Di Cao and Junbo Zhao and Weihao Hu and Fei Ding and Qi Huang and Zhe Chen},
This paper proposes a data-driven distributed voltage control approach based on the spectrum clustering and the enhanced multi-agent deep reinforcement learning (MADRL) algorithm. Via the unsupervised clustering, the whole distribution system can be decomposed into several sub-networks according to the voltage and reactive power sensitivity. Then, the distributed control problem of each sub-network is modeled as Markov games and solved by the enhanced MADRL algorithm, where each sub-network is… 

Figures from this paper

Stabilizing Voltage in Power Distribution Networks via Multi-Agent Reinforcement Learning with Transformer

The increased integration of renewable energy poses a slew of technical challenges for the operation of power distribution networks. Among them, voltage fluctuations caused by the instability of

Volt-VAR Optimization in Distribution Networks Using Twin Delayed Deep Reinforcement Learning

Modern distribution grids are undergoing new challenges due to the stochastic nature of distributed energy resources (DERs). High penetration of DERs has a significant impact on Volt-VAR profile and

Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review

This paper provides a comprehensive literature review of RL in terms of basic ideas, various types of algorithms, and their applications in power and energy systems.

Multi-Agent Reinforcement Learning for Active Voltage Control on Power Distribution Networks

This paper formulates the active voltage control problem in the framework of Dec-POMDP and establishes an open-source environment and aims to bridge the gap between the power community and the MARL community and be a drive force towards real-world applications of MARL algorithms.



Safe Off-Policy Deep Reinforcement Learning Algorithm for Volt-VAR Control in Power Distribution Systems

This work proposes a safe off-policy deep reinforcement learning algorithm to solve Volt-VAR control problems in a model-free manner, and outperforms the existing reinforcement learning algorithms and conventional optimization-based approaches on a large feeder.

Distributed Adaptive Robust Voltage/VAR Control With Network Partition in Active Distribution Networks

An alternating optimization procedure integrating a column-and-constraint generation algorithm and an alternating direction method of multipliers to solve the DAR-VVC problem is developed.

Network Partition and Voltage Coordination Control for Distribution Networks With High Penetration of Distributed PV Units

The proposed double-layer voltage control strategy combines the cluster autonomous optimization and distributed intercluster coordination optimization in different time scales to solve the voltage violation problem caused by high penetration of photovoltaic units in distribution power networks.

Local and Distributed Voltage Control Algorithms in Distribution Networks

In this paper, we consider a voltage control problem in power distribution grids. The specific goal is that of keeping the voltages within preassigned operating limits by commanding the reactive

Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning

A novel two-timescale voltage regulation scheme is developed for distribution grids by judiciously coupling data-driven with physics-based optimization, and extensive numerical tests corroborate the effectiveness of the novel scheme.

Reactive Power Ancillary Service of Synchronous DGs in Coordination With Voltage Control Devices

Simulation case studies were performed using MATLAB to demonstrate that the coordinated reactive power support of the DGs, OLTC, and SCs can achieve the objective effectively, resulting in improved voltage quality.

Network Partition-Based Zonal Voltage Control for Distribution Networks With Distributed PV Systems

A novel network partition approach based on a community detection algorithm is presented to realize zonal voltage control in a shorter control response time using the minimum amount of reactive power compensation and active power curtailment.

Distributed Control and Generation Estimation Method for Integrating High-Density Photovoltaic Systems

The presence of distributed generators (DGs) such as photovoltaic systems (PVs) is increasing significantly in distribution networks, and in order to accommodate a higher penetration of DGs,

Active Distribution Grid Management Based on Robust AC Optimal Power Flow

The proposed methodology for active grid management by which robust optimization is applied to accommodate spatial-temporal uncertainty allows the DSO to increase system reliability in the real-time operation.

On-Line Building Energy Optimization Using Deep Reinforcement Learning

The benefits of using deep reinforcement learning, a hybrid type of methods that combines reinforcement learning with deep learning, to perform on-line optimization of schedules for building energy management systems, are explored for the first time in the smart grid context.