Intelligent Predetermination of Generator Tripping Scheme: Knowledge Fusion-based Deep Reinforcement Learning Framework

被引:0
作者
Zeng, Lingkang [1 ,2 ]
Yao, Wei [1 ]
Hu, Ze [1 ]
Shuai, Hang [3 ]
Li, Zhouping [1 ]
Wen, Jinyu [1 ]
Cheng, Shijie [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect & Elect Engn, State Key Lab Adv Electromagnet Engn & Technol, Wuhan 430074, Peoples R China
[2] State Grid Corp China, Dispatching & Control Ctr, Cent China Branch, Wuhan 430077, Peoples R China
[3] Univ Tennessee, Dept Elect Engn & Comp Sci, Knoxville, TN 37996 USA
来源
CSEE JOURNAL OF POWER AND ENERGY SYSTEMS | 2024年 / 10卷 / 01期
基金
中国国家自然科学基金;
关键词
Transient analysis; Generators; Power system stability; Real-time systems; Aerospace electronics; Ions; Training; Deep reinforcement learning; generator tripping scheme; graph convolutional network; invalid action masking; knowledge fusion; INTEGRITY PROTECTION SCHEME; FREQUENCY CONTROL; VOLTAGE CONTROL; SYSTEM;
D O I
10.17775/CSEEJPES.2022.08970
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Generator tripping scheme (GTS) is the most commonly used scheme to prevent power systems from losing safety and stability. Usually, GTS is composed of offline predetermination and real-time scenario match. However, it is extremely time-consuming and labor-intensive for manual predetermination for a large-scale modern power system. To improve efficiency of predetermination, this paper proposes a framework of knowledge fusion-based deep reinforcement learning (KF-DRL) for intelligent predetermination of GTS. First, the Markov Decision Process (MDP) for GTS problem is formulated based on transient instability events. Then, linear action space is developed to reduce dimensionality of action space for multiple controllable generators. Especially, KF-DRL leverages domain knowledge about GTS to mask invalid actions during the decision-making process. This can enhance the efficiency and learning process. Moreover, the graph convolutional network (GCN) is introduced to the policy network for enhanced learning ability. Numerical simulation results obtained on New England power system demonstrate superiority of the proposed KF-DRL framework for GTS over the purely data-driven DRL method.
引用
收藏
页码:66 / 75
页数:10
相关论文
共 40 条
  • [1] Adaptive under-voltage load shedding scheme for large interconnected smart grids based on wide area synchrophasor measurements
    Adewole, Adeyemi Charles
    Tzoneva, Raynitchka
    Apostolov, Alexander
    [J]. IET GENERATION TRANSMISSION & DISTRIBUTION, 2016, 10 (08) : 1957 - 1968
  • [2] Industry experience with special protection schemes
    Anderson, PM
    LeReverend, BK
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 1996, 11 (03) : 1166 - 1176
  • [3] Methodology for the improvements in synchrophasor based System Integrity Protection Schemes under stressed conditions
    Ballal, Makarand Sudhakar
    Kulkarni, Amit Ramchandra
    Suryawanshi, Hiralal Murlidhar
    [J]. SUSTAINABLE ENERGY GRIDS & NETWORKS, 2021, 26
  • [4] Model-Free Emergency Frequency Control Based on Reinforcement Learning
    Chen, Chunyu
    Cui, Mingjian
    Li, Fangxing
    Yin, Shengfei
    Wang, Xinan
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (04) : 2336 - 2346
  • [5] PowerNet: Multi-Agent Deep Reinforcement Learning for Scalable Powergrid Control
    Chen, Dong
    Chen, Kaian
    Li, Zhaojian
    Chu, Tianshu
    Yao, Rui
    Qiu, Feng
    Lin, Kaixiang
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (02) : 1007 - 1017
  • [6] Active Power Correction Strategies Based on Deep Reinforcement Learning-Part II: A Distributed Solution for Adaptability
    Chen, Siyuan
    Duan, Jiajun
    Bai, Yuyang
    Zhang, Jun
    Shi, Di
    Wang, Zhiwei
    Dong, Xuzhu
    Sun, Yuanzhang
    [J]. CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2022, 8 (04): : 1134 - 1144
  • [7] Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
    Chen, Xin
    Qu, Guannan
    Tang, Yujie
    Low, Steven
    Li, Na
    [J]. IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (04) : 2935 - 2958
  • [8] Analysis on Special Protection Scheme of Korea Electric Power System by Fully Utilizing STATCOM in a Generation Side
    Choi, Dong-Hee
    Lee, Soo Hyoung
    Kang, Yong Cheol
    Park, Jung-Wook
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2017, 32 (03) : 1882 - 1890
  • [9] Design and construction of a multistage Zeeman decelerator for crossed molecular beams scattering experiments
    Cremers, Theo
    Janssen, Niek
    Sweers, Edwin
    van de Meerakker, Sebastiaan Y. T.
    [J]. REVIEW OF SCIENTIFIC INSTRUMENTS, 2019, 90 (01)
  • [10] Reinforcement Learning for Optimal Primary Frequency Control: A Lyapunov Approach
    Cui, Wenqi
    Jiang, Yan
    Zhang, Baosen
    [J]. IEEE TRANSACTIONS ON POWER SYSTEMS, 2023, 38 (02) : 1676 - 1688