Integrating Reinforcement Learning and Optimal Power Dispatch to Enhance Power Grid Resilience

被引:23
作者
Li, Qingming [1 ]
Zhang, Xi [1 ]
Guo, Jianbo [2 ]
Shan, Xiwen [1 ]
Wang, Zuowei [1 ]
Li, Zhen [1 ]
Tse, Chi K. [3 ]
机构
[1] Beijing Inst Technol, Sch Automat, Beijing 100081, Peoples R China
[2] China Elect Power Res Inst, Power Syst Dept, Beijing 100192, Peoples R China
[3] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Resilience; Power grids; Maintenance engineering; Power supplies; Reinforcement learning; Power system reliability; Power system protection; Power grid resilience; Q-Learning; sequential component repair; optimal power dispatch;
D O I
10.1109/TCSII.2021.3131316
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Power grids are vulnerable to extreme events that may cause the failure of multiple components and lead to severe power outages. It is of practical importance to design effective restoration strategies to enhance the power grid resilience. In this brief, we consider different time scales of various restoration methods and propose an integrated strategy to maximize the total amount of electricity supplied to the loads in the recovery process. The strategy properly combines the slow restoration method of component repair and the fast restoration method of optimal power dispatch. The Q-learning algorithm is used to generate the sequential order of repairing damaged components and update the network topology. Linear optimization is used to obtain the largest amount of power supply on given network topology. Simulation results show that our proposed method can coordinate the available resources and manpower to effectively restore the power grid after extreme events.
引用
收藏
页码:1402 / 1406
页数:5
相关论文
共 20 条
[1]   A Survey on Power System Blackout and Cascading Events: Research Motivations and Challenges [J].
Alhelou, Hassan Haes ;
Hamedani-Golshan, Mohamad Esmail ;
Njenda, Takawira Cuthbert ;
Siano, Pierluigi .
ENERGIES, 2019, 12 (04)
[2]   Resilient Transmission Hardening Planning in a High Renewable Penetration Era [J].
Bagheri, Ali ;
Zhao, Chaoyue ;
Qiu, Feng ;
Wang, Jianhui .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2019, 34 (02) :873-882
[3]   Sequential Restorations of Complex Networks After Cascading Failures [J].
Huang, Yuxuan ;
Wu, Jiajing ;
Ren, Wendi ;
Tse, Chi K. ;
Zheng, Zibin .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (01) :400-411
[4]   A Combined Repair Crew Dispatch Problem for Resilient Electric and Natural Gas System Considering Reconfiguration and DG Islanding [J].
Lin, Yanling ;
Chen, Bo ;
Wang, Jianhui ;
Bie, Zhaohong .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2019, 34 (04) :2755-2767
[5]   A Tutorial on Modeling and Analysis of Cascading Failure in Future Power Grids [J].
Liu, Dong ;
Zhang, Xi ;
Tse, Chi K. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2021, 68 (01) :49-55
[6]   Learning to run a power network challenge for training topology controllers [J].
Marot, Antoine ;
Donnot, Benjamin ;
Romero, Camilo ;
Donon, Balthazar ;
Lerousseau, Marvin ;
Veyrin-Forrer, Luca ;
Guyon, Isabelle .
ELECTRIC POWER SYSTEMS RESEARCH, 2020, 189
[7]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[8]   Boosting the Power Grid Resilience to Extreme Weather Events Using Defensive Islanding [J].
Panteli, Mathaios ;
Trakas, Dimitris N. ;
Mancarella, Pierluigi ;
Hatziargyriou, Nikos D. .
IEEE TRANSACTIONS ON SMART GRID, 2016, 7 (06) :2913-2922
[9]   Vulnerability Assessment of Power Grids Against Link-Based Attacks [J].
Pu, Cunlai ;
Wu, Pang ;
Xia, Yongxiang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (10) :2209-2213
[10]   Mastering the game of Go without human knowledge [J].
Silver, David ;
Schrittwieser, Julian ;
Simonyan, Karen ;
Antonoglou, Ioannis ;
Huang, Aja ;
Guez, Arthur ;
Hubert, Thomas ;
Baker, Lucas ;
Lai, Matthew ;
Bolton, Adrian ;
Chen, Yutian ;
Lillicrap, Timothy ;
Hui, Fan ;
Sifre, Laurent ;
van den Driessche, George ;
Graepel, Thore ;
Hassabis, Demis .
NATURE, 2017, 550 (7676) :354-+