Real-time power system dispatch scheme using grid expert strategy-based imitation learning

被引:0
|
作者
Xu, Siyang [1 ]
Zhu, Jiebei [1 ]
Li, Bingsen [1 ]
Yu, Lujie [1 ]
Zhu, Xueke [1 ]
Jia, Hongjie [1 ]
Chung, Chi Yung [2 ]
Booth, Campbell D. [3 ]
Terzija, Vladimir [4 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[3] Univ Strathclyde, Dept Elect & Elect Engn, Glasgow, Lanarkshire, Scotland
[4] Univ Manchester, Sch Elect & Elect Engn, Manchester, England
关键词
Real-time dispatch; Imitation learning; Grid export strategy; N-1 security operation; Reinforcement learning; DEEP; OPERATION;
D O I
10.1016/j.ijepes.2024.110148
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With large-scale grid integration of renewable energy sources (RES), power grid operations gradually exhibit the new characteristics of high-order uncertainty, leading to significant challenges for system operational security. Traditional model-driven generation dispatch methods require large computational resources, whereas the widely concerned Reinforcement Learning (RL)-based methods lead to issues such as slow training speed due to the high complexity and dimension of processed grid state information. For this reason, this paper proposes a novel Grid Expert Strategy Imitation Learning (GESIL)-based real-time (5 min intervals in this paper) dispatch method. Firstly, a grid model is established based on the graph theory. Secondly, a pure rule-based grid expert strategy (GES) considering detailed power grid operations is proposed. Then, the GES is combined with the established model to obtain a GESIL agent using imitation learning by offline-online training, which can produce specific grid dispatch decisions for real-time. By designing a graph theory-based grid model, a model-driven purely rule-based GES, and embedding a penalty factor-based loss function into IL offline- online training, GESIL ultimately achieves high training speed, high solution speed, and strong generalization capability. A modified IEEE 118-node system is employed to compare the proposed GESIL to traditional dispatch method and RL method. Results show that GESIL has significantly improved computational efficiency by approximately 17 times and training speed by 14.5 times. GESIL can more stably and efficiently compute real-time dispatch decisions of grid operations, enhancing the optimization effect in terms of transmission overloading mitigation, transmission loading optimization, and power balancing control.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Real-time Security Dispatch of Modern Power System Based on Grid Expert Strategy Imitation Learning
    Zhu J.
    Xu S.
    Li B.
    Wang Y.
    Wang Y.
    Yu L.
    Xiong X.
    Wang C.
    Dianwang Jishu/Power System Technology, 2023, 47 (02): : 517 - 528
  • [2] Two-stage Correction Strategy-based Real-time Dispatch for Economic Operation of Microgrids
    Sun, Jingliao
    Hu, Changhong
    Liu, Lei
    Zhao, Bei
    Liu, Jinyuan
    Shi, Jianquan
    CHINESE JOURNAL OF ELECTRICAL ENGINEERING, 2022, 8 (02): : 42 - 51
  • [3] Imitation Learning Based Real-Time Decision-Making of Microgrid Economic Dispatch Under Multiple Uncertainties
    Dong, Wei
    Zhang, Fan
    Li, Meng
    Fang, Xiaolun
    Yang, Qiang
    JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2024, 12 (04) : 1183 - 1193
  • [4] Real-time Decision Making for Power System via Imitation Learning and Reinforcement Learning
    Guo, Lei
    Guo, Jun
    Zhang, Yong
    Guo, Wanshu
    Xue, Yanjun
    Wang, Lipeng
    2022 IEEE/IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (I&CPS ASIA 2022), 2022, : 744 - 748
  • [5] Real-time Dispatch Strategy for Electric Vehicles Based on Deep Reinforcement Learning
    Li H.
    Li G.
    Wang K.
    Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2020, 44 (22): : 161 - 167
  • [6] Market-based real-time dispatch in the Hellenic power system
    Passelergue, J
    Simon, P
    Blanas, I
    Philippou, M
    Nikolaou, P
    Michos, D
    Christoforidis, G
    2004 IEEE POWER ENGINEERING SOCIETY GENERAL MEETING, VOLS 1 AND 2, 2004, : 996 - 1001
  • [7] Dynamic Economic Dispatch of Power System Based on Generative Adversarial Imitation Learning
    Chen H.
    Meng F.
    Zhang Y.
    Sun Y.
    Zhang J.
    Shan L.
    Lü X.
    Zhang P.
    Dianwang Jishu/Power System Technology, 2022, 46 (11): : 4373 - 4380
  • [8] Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy
    Zheng, Lingwei
    Wu, Hao
    Guo, Siqi
    Sun, Xinyu
    ENERGY, 2023, 277
  • [9] Real-Time Spatiotemporal Assistance for Micromanipulation Using Imitation Learning
    Mori, Ryoya
    Aoyama, Tadayoshi
    Kobayashi, Taisuke
    Sakamoto, Kazuya
    Takeuchi, Masaru
    Hasegawa, Yasuhisa
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04) : 3506 - 3513
  • [10] Humanoids skill learning based on real-time human motion imitation using Kinect
    Elbasiony, Reda
    Gomaa, Walid
    INTELLIGENT SERVICE ROBOTICS, 2018, 11 (02) : 149 - 169