Transmission Interface Power Flow Adjustment: A Deep Reinforcement Learning Approach Based on Multi-Task Attribution Map

被引:8
作者
Liu, Shunyu [1 ]
Luo, Wei [1 ]
Zhou, Yanzhen [2 ]
Chen, Kaixuan [1 ]
Zhang, Quan [3 ]
Xu, Huating [3 ]
Guo, Qinglai [2 ]
Song, Mingli [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[3] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
基金
国家重点研发计划;
关键词
Attribution map; deep reinforcement learning; multi-task learning; power flow adjustment; transmission interface; VOLTAGE CONTROL; OPTIMIZATION; CONGESTION; ALGORITHMS;
D O I
10.1109/TPWRS.2023.3298007
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and uncertainties occur in power systems, where the adjustment problems of different transmission interfaces are often treated as several independent tasks, ignoring their coupling relationship and even leading to conflict decisions. In this article, we introduce a novel data-driven deep reinforcement learning (DRL) approach, to handle multiple power flow adjustment tasks jointly instead of learning each task from scratch. At the heart of the proposed method is a multi-task attribution map (MAM), which enables the DRL agent to explicitly attribute each transmission interface task to different power system nodes with task-adaptive attention weights. Based on this MAM, the agent can further provide effective strategies to solve the multi-task adjustment problem with a near-optimal operation cost. Simulation results on the IEEE 118-bus system, a realistic 300-bus system in China, and a very large European system with 9241 buses demonstrate that the proposed method significantly improves the performance compared with several baseline methods, and exhibits high interpretability with the learnable MAM.
引用
收藏
页码:3324 / 3335
页数:12
相关论文
共 39 条
[1]   Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems [J].
Cao, Di ;
Zhao, Junbo ;
Hu, Weihao ;
Yu, Nanpeng ;
Ding, Fei ;
Huang, Qi ;
Chen, Zhe .
IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (01) :149-165
[2]   Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review [J].
Cao, Di ;
Hu, Weihao ;
Zhao, Junbo ;
Zhang, Guozhou ;
Zhang, Bin ;
Liu, Zhou ;
Chen, Zhe ;
Blaabjerg, Frede .
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, 2020, 8 (06) :1029-1042
[3]   State-of-the-art, challenges, and future trends in security constrained optimal power flow [J].
Capitanescu, F. ;
Martinez Ramos, J. L. ;
Panciatici, P. ;
Kirschen, D. ;
Marano Marcolini, A. ;
Platbrood, L. ;
Wehenkel, L. .
ELECTRIC POWER SYSTEMS RESEARCH, 2011, 81 (08) :1731-1741
[4]   Model-Free Emergency Frequency Control Based on Reinforcement Learning [J].
Chen, Chunyu ;
Cui, Mingjian ;
Li, Fangxing ;
Yin, Shengfei ;
Wang, Xinan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (04) :2336-2346
[5]   Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges [J].
Chen, Xin ;
Qu, Guannan ;
Tang, Yujie ;
Low, Steven ;
Li, Na .
IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (04) :2935-2958
[6]   Distributed Reinforcement Learning Algorithm for Dynamic Economic Dispatch With Unknown Generation Cost Functions [J].
Dai, Pengcheng ;
Yu, Wenwu ;
Wen, Guanghui ;
Baldi, Simone .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (04) :2258-2267
[7]   Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations [J].
Duan, Jiajun ;
Shi, Di ;
Diao, Ruisheng ;
Li, Haifeng ;
Wang, Zhiwei ;
Zhang, Bei ;
Bian, Desong ;
Yi, Zhehan .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2020, 35 (01) :814-817
[8]   Optimal Rescheduling of Generators for Congestion Management Based on Particle Swarm Optimization [J].
Dutta, Sudipta ;
Singh, S. P. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2008, 23 (04) :1560-1569
[9]   Contingency Ranking With Respect to Overloads in Very Large Power Systems Taking Into Account Uncertainty, Preventive, and Corrective Actions [J].
Fliscounakis, Stephane ;
Panciatici, Patrick ;
Capitanescu, Florin ;
Wehenkel, Louis .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2013, 28 (04) :4909-4917
[10]   Hybrid Deep Learning for Dynamic Total Transfer Capability Control [J].
Gao, Qiu ;
Liu, Youbo ;
Zhao, Junbo ;
Liu, Junyong ;
Chung, Chi Yung .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2021, 36 (03) :2733-2736