Real-time power system dispatch scheme using grid expert strategy-based imitation learning

被引:0
|
作者
Xu, Siyang [1 ]
Zhu, Jiebei [1 ]
Li, Bingsen [1 ]
Yu, Lujie [1 ]
Zhu, Xueke [1 ]
Jia, Hongjie [1 ]
Chung, Chi Yung [2 ]
Booth, Campbell D. [3 ]
Terzija, Vladimir [4 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[3] Univ Strathclyde, Dept Elect & Elect Engn, Glasgow, Lanarkshire, Scotland
[4] Univ Manchester, Sch Elect & Elect Engn, Manchester, England
关键词
Real-time dispatch; Imitation learning; Grid export strategy; N-1 security operation; Reinforcement learning; DEEP; OPERATION;
D O I
10.1016/j.ijepes.2024.110148
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With large-scale grid integration of renewable energy sources (RES), power grid operations gradually exhibit the new characteristics of high-order uncertainty, leading to significant challenges for system operational security. Traditional model-driven generation dispatch methods require large computational resources, whereas the widely concerned Reinforcement Learning (RL)-based methods lead to issues such as slow training speed due to the high complexity and dimension of processed grid state information. For this reason, this paper proposes a novel Grid Expert Strategy Imitation Learning (GESIL)-based real-time (5 min intervals in this paper) dispatch method. Firstly, a grid model is established based on the graph theory. Secondly, a pure rule-based grid expert strategy (GES) considering detailed power grid operations is proposed. Then, the GES is combined with the established model to obtain a GESIL agent using imitation learning by offline-online training, which can produce specific grid dispatch decisions for real-time. By designing a graph theory-based grid model, a model-driven purely rule-based GES, and embedding a penalty factor-based loss function into IL offline- online training, GESIL ultimately achieves high training speed, high solution speed, and strong generalization capability. A modified IEEE 118-node system is employed to compare the proposed GESIL to traditional dispatch method and RL method. Results show that GESIL has significantly improved computational efficiency by approximately 17 times and training speed by 14.5 times. GESIL can more stably and efficiently compute real-time dispatch decisions of grid operations, enhancing the optimization effect in terms of transmission overloading mitigation, transmission loading optimization, and power balancing control.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] A novel continual reinforcement learning-based expert system for self-optimization of soft real-time systems
    Masood, Zafar
    Jiangbin, Zheng
    Ahmad, Idrees
    Dongdong, Chai
    Shabbir, Wasif
    Irfan, Muhammad
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [32] Real-time heliostat field aiming strategy optimization based on reinforcement learning
    Zeng, Zhichen
    Ni, Dong
    Xiao, Gang
    APPLIED ENERGY, 2022, 307
  • [33] Optimal Operation Strategy of Virtual Power Plant Considering Real-Time Dispatch Uncertainty of Distributed Energy Resource Aggregation
    Lee, Jinho
    Won, Dongjun
    IEEE ACCESS, 2021, 9 (09): : 56965 - 56983
  • [34] A real-time energy dispatch strategy based on the energy cooperative optimization complementarity model of multi-microgrids
    Wang, Zhipeng
    Wu, Nan
    JOURNAL OF RENEWABLE AND SUSTAINABLE ENERGY, 2024, 16 (01)
  • [35] System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy Games
    Sur, Indranil
    Daniels, Zachary
    Rahman, Abrar
    Faber, Kamil
    Gallardo, Gianmarco J.
    Hayes, Tyler L.
    Taylor, Cameron E.
    Gurbuz, Mustafa Burak
    Smith, James
    Joshi, Sahana
    Japkowicz, Nathalie
    Baron, Michael
    Kira, Zsolt
    Kanan, Christopher
    Corizzo, Roberto
    Divakaran, Ajay
    Piacentino, Michael
    Hostetler, Jesse
    Raghavan, Aswin
    SECOND INTERNATIONAL CONFERENCE ON AIML SYSTEMS 2022, 2022,
  • [36] Real-time Dispatch with Risk Considerations for Wind Power Integrated System Aiming at Security-economy Coordination
    Shao, Jian
    Wu, Jia-si
    Liu, Wei
    Zhao, Xin-dong
    Dai, Wei
    Zhang, Bu-han
    2016 INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATION (ICEEA 2016), 2016,
  • [37] Stochastic Robust Real-Time Power Dispatch With Wind Uncertainty Using Difference- of-Convexity Optimization
    Qu, Kaiping
    Zheng, Xiaodong
    Li, Xiaoqiang
    Lv, Chaoxian
    Yu, Tao
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (06) : 4497 - 4511
  • [38] A Two-Layer Model for Microgrid Real-Time Dispatch Based on Energy Storage System Charging/Discharging Hidden Costs
    Zhang, Zhong
    Wang, Jianxue
    Ding, Tao
    Wang, Xiuli
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2017, 8 (01) : 33 - 42
  • [39] Real-time power optimization based on Q-learning algorithm for direct methanol fuel cell system
    Chi, Xuncheng
    Chen, Fengxiang
    Zhai, Shuang
    Hu, Zhe
    Zhou, Su
    Wei, Wei
    INTERNATIONAL JOURNAL OF HYDROGEN ENERGY, 2024, 89 : 1241 - 1253
  • [40] Real-time subsidy based robust scheduling of the integrated power and gas system
    Shu, Kangan
    Ai, Xiaomeng
    Fang, Jiakun
    Yao, Wei
    Chen, Zhe
    He, Haibo
    Wen, Jinyu
    APPLIED ENERGY, 2019, 236 : 1158 - 1167