Network Reconfiguration for Enhanced Operational Resilience using Reinforcement Learning

Michael Abdelmalak, Mukesh Gautam, Sean Morash, Aaron F. Snyder, Eliza Hotchkiss, Mohammed Benidris

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

This paper proposes a reinforcement learning-based approach for distribution network reconfiguration(DNR) to enhance the resilience of the electric power supply. Resilience enhancements usually require solving large-scale stochastic optimization problems that are computationally expensive and sometimes infeasible. The exceptional performance of reinforcement learning techniques has encouraged their adoption in various power system control studies, specifically resilience-based real-time applications. In this paper, a single agent framework is developed using an Actor-Critic algorithm (ACA) to determine statuses of tie-switches in a distribution feeder impacted by an extreme weather event. The proposed approach provides a fast-acting control algorithm that reconfigures the feeder topology to reduce or even avoid load shedding. The problem is formulated as a discrete Markov decision process in such a way that a system state captures the system topology and its operational characteristics. An action is made to open or close a specific set of tie-switches after which a reward is calculated to evaluate the practicality and advantage of that action. The iterative Markov process is used to train the proposed ACA under diverse failure scenarios and is demonstrated on the 33-node distribution feeder system. Results show the capability of the proposed ACA to determine proper switching action of tie-switches with accuracy exceeding 93%.

Original languageEnglish
Title of host publicationSEST 2022 - 5th International Conference on Smart Energy Systems and Technologies
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665405577
ISBN (Print)9781665405577
DOIs
StatePublished - Sep 28 2022
Externally publishedYes
Event5th International Conference on Smart Energy Systems and Technologies, SEST 2022 - Eindhoven, Netherlands
Duration: Sep 5 2022Sep 7 2022

Publication series

NameSEST 2022 - 5th International Conference on Smart Energy Systems and Technologies

Conference

Conference5th International Conference on Smart Energy Systems and Technologies, SEST 2022
Country/TerritoryNetherlands
CityEindhoven
Period09/5/2209/7/22

Keywords

  • Actor critic
  • Markov decision process
  • network reconfiguration
  • reinforcement learning
  • resilience

Fingerprint

Dive into the research topics of 'Network Reconfiguration for Enhanced Operational Resilience using Reinforcement Learning'. Together they form a unique fingerprint.

Cite this