Real-time power system dispatch scheme using grid expert strategy-based imitation learning

被引:0
|
作者
Xu, Siyang [1 ]
Zhu, Jiebei [1 ]
Li, Bingsen [1 ]
Yu, Lujie [1 ]
Zhu, Xueke [1 ]
Jia, Hongjie [1 ]
Chung, Chi Yung [2 ]
Booth, Campbell D. [3 ]
Terzija, Vladimir [4 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[2] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[3] Univ Strathclyde, Dept Elect & Elect Engn, Glasgow, Lanarkshire, Scotland
[4] Univ Manchester, Sch Elect & Elect Engn, Manchester, England
关键词
Real-time dispatch; Imitation learning; Grid export strategy; N-1 security operation; Reinforcement learning; DEEP; OPERATION;
D O I
10.1016/j.ijepes.2024.110148
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With large-scale grid integration of renewable energy sources (RES), power grid operations gradually exhibit the new characteristics of high-order uncertainty, leading to significant challenges for system operational security. Traditional model-driven generation dispatch methods require large computational resources, whereas the widely concerned Reinforcement Learning (RL)-based methods lead to issues such as slow training speed due to the high complexity and dimension of processed grid state information. For this reason, this paper proposes a novel Grid Expert Strategy Imitation Learning (GESIL)-based real-time (5 min intervals in this paper) dispatch method. Firstly, a grid model is established based on the graph theory. Secondly, a pure rule-based grid expert strategy (GES) considering detailed power grid operations is proposed. Then, the GES is combined with the established model to obtain a GESIL agent using imitation learning by offline-online training, which can produce specific grid dispatch decisions for real-time. By designing a graph theory-based grid model, a model-driven purely rule-based GES, and embedding a penalty factor-based loss function into IL offline- online training, GESIL ultimately achieves high training speed, high solution speed, and strong generalization capability. A modified IEEE 118-node system is employed to compare the proposed GESIL to traditional dispatch method and RL method. Results show that GESIL has significantly improved computational efficiency by approximately 17 times and training speed by 14.5 times. GESIL can more stably and efficiently compute real-time dispatch decisions of grid operations, enhancing the optimization effect in terms of transmission overloading mitigation, transmission loading optimization, and power balancing control.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Adaptive and Predictive Energy Management Strategy for Real-Time Optimal Power Dispatch From VPPs Integrated With Renewable Energy and Energy Storage
    Mohy-ud-din, Ghulam
    Muttaqi, Kashem M.
    Sutanto, Danny
    IEEE TRANSACTIONS ON INDUSTRY APPLICATIONS, 2021, 57 (03) : 1958 - 1972
  • [42] A Real-Time Intelligent Energy Management Strategy for Hybrid Electric Vehicles Using Reinforcement Learning
    Lee, Woong
    Jeoung, Haeseong
    Park, Dohyun
    Kim, Tacksu
    Lee, Heeyun
    Kim, Namwook
    IEEE ACCESS, 2021, 9 : 72759 - 72768
  • [43] Reinforcement Learning Based Real-Time Wide-Area Stabilizing Control Agents to Enhance Power System Stability
    Hadidi, Ramtin
    Jeyasurya, Benjamin
    IEEE TRANSACTIONS ON SMART GRID, 2013, 4 (01) : 489 - 497
  • [44] A reinforcement learning-based online learning strategy for real-time short-term load forecasting
    Wang, Xinlin
    Wang, Hao
    Li, Shengping
    Jin, Haizhen
    ENERGY, 2024, 305
  • [45] Real-Time Dispatch for Multi-Unit Hydroelectric Plants With AC Optimal Power Flow: The Case of the Santo Antonio System
    Filho, Danilo P. C.
    Finardi, Erlon C.
    Aquino, Antonio F. C.
    IEEE ACCESS, 2021, 9 : 149322 - 149337
  • [46] Machine-Learning-Based Real-Time Economic Dispatch in Islanding Microgrids in a Cloud-Edge Computing Environment
    Dong, Wei
    Yang, Qiang
    Li, Wei
    Zomaya, Albert Y.
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (17): : 13703 - 13711
  • [47] Learning-based Optimization of Active Distribution System Dispatch in Industrial Park Considering the Peak Operation Demand of Power Grid
    Tang H.
    Liu C.
    Yang M.
    Tang B.-Q.
    Xu D.
    Lv K.
    Zidonghua Xuebao/Acta Automatica Sinica, 2021, 47 (10): : 2449 - 2463
  • [48] Real-time scheduling strategy optimization for electric vehicle battery swapping station based on reinforcement learning
    Zhang W.
    Li R.
    Zang X.
    Yan J.
    Zhu J.
    Dianli Zidonghua Shebei/Electric Power Automation Equipment, 2022, 42 (10): : 134 - 141
  • [49] Improved reinforcement learning-based real-time energy scheduling for prosumer with elastic loads in smart grid
    Liu, Didi
    Cheng, Pengpeng
    Cheng, Jun
    Liu, Junxiu
    Lu, Meiqu
    Jiang, Frank
    KNOWLEDGE-BASED SYSTEMS, 2023, 280
  • [50] A Real-time Digital Simulator Accelerated Reinforcement Learning Training Environment for Power System Frequency Dynamics
    Aslamit, Pooja
    Aryal, Tara
    Bhujel, Niranjan
    Rekabdarkolaee, Hossein Moradi
    Fu, Kaiqun
    Wang, Zongjie
    Hansen, Timothy M.
    2024 56TH NORTH AMERICAN POWER SYMPOSIUM, NAPS 2024, 2024,