TY - GEN
T1 - A Reinforced Learning Approach to Dispatch Distributed Generators for Enhanced Resilience
AU - Abdelmalak, Michael
AU - Kamruzzaman, M. D.
AU - Morash, Sean
AU - Snyder, Aaron F.
AU - Benidris, Mohammed
N1 - Funding Information:
ACKNOWLEDGEMENT This work was supported by the U.S. National Science Foundation (NSF) under Grant NSF 1847578.
Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - This paper proposes a reinforced learning-based approach for dispatching distributed generators to enhance operational resilience of electric distribution systems against hurricanes. Existing resilience enhancement approaches rely on solving large-scale optimization problems that are computationally expensive and time demanding, which are not suitable for real-time applications. In this paper, a multi-agent framework is developed using a Soft Actor Critic algorithm to dispatch distributed generators for resilience enhancement. The proposed approach provides a fast-acting control algorithm that determines the size and the location of distributed generators to reduce the amount of load curtailment during hurricanes. The problem is formulated as a Markov decision process that consists of system states, an action space, and a reward scheme. A system state represents the system topology and characteristics upon which an action is taken and a reward value is calculated. An iterative Markov decision process is used to train the proposed Soft Actor Critic algorithm using multiple line outages generated from a hurricane fragility model. The trained network dispatches distributed generators whenever there are islanded grids and load curtailments. The proposed method is demonstrated on the IEEE 33-node distribution feeder system. The results show the capability of the proposed algorithm to determine optimal sizes and locations of distributed generators for resilience enhancement.
AB - This paper proposes a reinforced learning-based approach for dispatching distributed generators to enhance operational resilience of electric distribution systems against hurricanes. Existing resilience enhancement approaches rely on solving large-scale optimization problems that are computationally expensive and time demanding, which are not suitable for real-time applications. In this paper, a multi-agent framework is developed using a Soft Actor Critic algorithm to dispatch distributed generators for resilience enhancement. The proposed approach provides a fast-acting control algorithm that determines the size and the location of distributed generators to reduce the amount of load curtailment during hurricanes. The problem is formulated as a Markov decision process that consists of system states, an action space, and a reward scheme. A system state represents the system topology and characteristics upon which an action is taken and a reward value is calculated. An iterative Markov decision process is used to train the proposed Soft Actor Critic algorithm using multiple line outages generated from a hurricane fragility model. The trained network dispatches distributed generators whenever there are islanded grids and load curtailments. The proposed method is demonstrated on the IEEE 33-node distribution feeder system. The results show the capability of the proposed algorithm to determine optimal sizes and locations of distributed generators for resilience enhancement.
KW - Distribution system
KW - extreme weather events
KW - reinforced learning
KW - resilience
UR - https://www.scopus.com/pages/publications/85141470655
UR - https://www.mendeley.com/catalogue/21006f42-020a-3dea-adaf-ef052d35bccc/
U2 - 10.1109/PESGM48719.2022.9916963
DO - 10.1109/PESGM48719.2022.9916963
M3 - Conference contribution
AN - SCOPUS:85141470655
T3 - IEEE Power and Energy Society General Meeting
BT - 2022 IEEE Power and Energy Society General Meeting, PESGM 2022
PB - IEEE Computer Society
T2 - 2022 IEEE Power and Energy Society General Meeting, PESGM 2022
Y2 - 17 July 2022 through 21 July 2022
ER -