共 39 条
Transmission Interface Power Flow Adjustment: A Deep Reinforcement Learning Approach Based on Multi-Task Attribution Map
被引:8
作者:

Liu, Shunyu
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Luo, Wei
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Zhou, Yanzhen
论文数: 0 引用数: 0
h-index: 0
机构:
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Chen, Kaixuan
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Zhang, Quan
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Xu, Huating
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Guo, Qinglai
论文数: 0 引用数: 0
h-index: 0
机构:
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China

Song, Mingli
论文数: 0 引用数: 0
h-index: 0
机构:
Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
机构:
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[3] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
基金:
国家重点研发计划;
关键词:
Attribution map;
deep reinforcement learning;
multi-task learning;
power flow adjustment;
transmission interface;
VOLTAGE CONTROL;
OPTIMIZATION;
CONGESTION;
ALGORITHMS;
D O I:
10.1109/TPWRS.2023.3298007
中图分类号:
TM [电工技术];
TN [电子技术、通信技术];
学科分类号:
0808 ;
0809 ;
摘要:
Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and uncertainties occur in power systems, where the adjustment problems of different transmission interfaces are often treated as several independent tasks, ignoring their coupling relationship and even leading to conflict decisions. In this article, we introduce a novel data-driven deep reinforcement learning (DRL) approach, to handle multiple power flow adjustment tasks jointly instead of learning each task from scratch. At the heart of the proposed method is a multi-task attribution map (MAM), which enables the DRL agent to explicitly attribute each transmission interface task to different power system nodes with task-adaptive attention weights. Based on this MAM, the agent can further provide effective strategies to solve the multi-task adjustment problem with a near-optimal operation cost. Simulation results on the IEEE 118-bus system, a realistic 300-bus system in China, and a very large European system with 9241 buses demonstrate that the proposed method significantly improves the performance compared with several baseline methods, and exhibits high interpretability with the learnable MAM.
引用
收藏
页码:3324 / 3335
页数:12
相关论文
共 39 条
[1]
Deep Reinforcement Learning Enabled Physical-Model-Free Two-Timescale Voltage Control Method for Active Distribution Systems
[J].
Cao, Di
;
Zhao, Junbo
;
Hu, Weihao
;
Yu, Nanpeng
;
Ding, Fei
;
Huang, Qi
;
Chen, Zhe
.
IEEE TRANSACTIONS ON SMART GRID,
2022, 13 (01)
:149-165

Cao, Di
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China

Zhao, Junbo
论文数: 0 引用数: 0
h-index: 0
机构:
Mississippi State Univ, Dept Elect & Comp Engn, Starkville, MS 39762 USA Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China

Hu, Weihao
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China

Yu, Nanpeng
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Calif Riverside, Dept Elect & Comp Engn, Riverside, CA 92521 USA Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China

Ding, Fei
论文数: 0 引用数: 0
h-index: 0
机构:
Power Syst Engn Ctr, Natl Renewable Energy Lab, Golden, CO 80401 USA Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China

Huang, Qi
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 611731, Sichuan, Peoples R China
Chengdu Univ Technol, Coll Energy, Chengdu 610059, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China

Chen, Zhe
论文数: 0 引用数: 0
h-index: 0
机构:
Aalborg Univ, Dept Energy Technol, DK-9220 Aalborg, Denmark Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Chengdu 610054, Peoples R China
[2]
Reinforcement Learning and Its Applications in Modern Power and Energy Systems: A Review
[J].
Cao, Di
;
Hu, Weihao
;
Zhao, Junbo
;
Zhang, Guozhou
;
Zhang, Bin
;
Liu, Zhou
;
Chen, Zhe
;
Blaabjerg, Frede
.
JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY,
2020, 8 (06)
:1029-1042

Cao, Di
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Hu, Weihao
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Zhao, Junbo
论文数: 0 引用数: 0
h-index: 0
机构:
Mississippi State Univ, Dept Elect & Comp Engn, Starkville, MS USA Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Zhang, Guozhou
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Zhang, Bin
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Liu, Zhou
论文数: 0 引用数: 0
h-index: 0
机构:
Aalborg Univ, Dept Energy Technol, Aalborg, Denmark Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Chen, Zhe
论文数: 0 引用数: 0
h-index: 0
机构:
Aalborg Univ, Dept Energy Technol, Aalborg, Denmark Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China

Blaabjerg, Frede
论文数: 0 引用数: 0
h-index: 0
机构:
Aalborg Univ, Dept Energy Technol, Aalborg, Denmark Univ Elect Sci & Technol China, Sch Mech & Elect Engn, Wide Area Measurement & Control Sichuan Prov Key, Chengdu, Peoples R China
[3]
State-of-the-art, challenges, and future trends in security constrained optimal power flow
[J].
Capitanescu, F.
;
Martinez Ramos, J. L.
;
Panciatici, P.
;
Kirschen, D.
;
Marano Marcolini, A.
;
Platbrood, L.
;
Wehenkel, L.
.
ELECTRIC POWER SYSTEMS RESEARCH,
2011, 81 (08)
:1731-1741

Capitanescu, F.
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

Martinez Ramos, J. L.
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Seville, Dept Elect Engn, Seville, Spain Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

Panciatici, P.
论文数: 0 引用数: 0
h-index: 0
机构:
RTE DMA, Versailles, France Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

Kirschen, D.
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Washington, Dept Elect Engn, Seattle, WA 98195 USA Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

Marano Marcolini, A.
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Seville, Dept Elect Engn, Seville, Spain Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

Platbrood, L.
论文数: 0 引用数: 0
h-index: 0
机构:
Tractebel Engn, Brussels, Belgium Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium

Wehenkel, L.
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium
[4]
Model-Free Emergency Frequency Control Based on Reinforcement Learning
[J].
Chen, Chunyu
;
Cui, Mingjian
;
Li, Fangxing
;
Yin, Shengfei
;
Wang, Xinan
.
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,
2021, 17 (04)
:2336-2346

Chen, Chunyu
论文数: 0 引用数: 0
h-index: 0
机构:
China Univ Min & Technol, Sch Elect & Power Engn, Xuzhou 221116, Jiangsu, Peoples R China China Univ Min & Technol, Sch Elect & Power Engn, Xuzhou 221116, Jiangsu, Peoples R China

Cui, Mingjian
论文数: 0 引用数: 0
h-index: 0
机构:
Southern Methodist Univ, Bobby B Lyle Sch Engn, Dept Elect Engn, Dallas, TX 75275 USA China Univ Min & Technol, Sch Elect & Power Engn, Xuzhou 221116, Jiangsu, Peoples R China

Li, Fangxing
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Tennessee, EECS, Knoxville, TN 37996 USA China Univ Min & Technol, Sch Elect & Power Engn, Xuzhou 221116, Jiangsu, Peoples R China

Yin, Shengfei
论文数: 0 引用数: 0
h-index: 0
机构:
Southern Methodist Univ, Bobby B Lyle Sch Engn, Dallas, TX 75275 USA China Univ Min & Technol, Sch Elect & Power Engn, Xuzhou 221116, Jiangsu, Peoples R China

论文数: 引用数:
h-index:
机构:
[5]
Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
[J].
Chen, Xin
;
Qu, Guannan
;
Tang, Yujie
;
Low, Steven
;
Li, Na
.
IEEE TRANSACTIONS ON SMART GRID,
2022, 13 (04)
:2935-2958

Chen, Xin
论文数: 0 引用数: 0
h-index: 0
机构:
Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA

Qu, Guannan
论文数: 0 引用数: 0
h-index: 0
机构:
Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA

Tang, Yujie
论文数: 0 引用数: 0
h-index: 0
机构:
Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA

Low, Steven
论文数: 0 引用数: 0
h-index: 0
机构:
CALTECH, Dept Comp & Math Sci, Pasadena, CA 91125 USA Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA

Li, Na
论文数: 0 引用数: 0
h-index: 0
机构:
Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA Harvard Univ, Sch Engn & Appl Sci, Cambridge, MA 02138 USA
[6]
Distributed Reinforcement Learning Algorithm for Dynamic Economic Dispatch With Unknown Generation Cost Functions
[J].
Dai, Pengcheng
;
Yu, Wenwu
;
Wen, Guanghui
;
Baldi, Simone
.
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS,
2020, 16 (04)
:2258-2267

Dai, Pengcheng
论文数: 0 引用数: 0
h-index: 0
机构:
Southeast Univ, Sch Math, Nanjing 210096, Peoples R China Southeast Univ, Sch Math, Nanjing 210096, Peoples R China

Yu, Wenwu
论文数: 0 引用数: 0
h-index: 0
机构:
Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
Nantong Univ, Dept Elect Engn, Nantong 226019, Peoples R China Southeast Univ, Sch Math, Nanjing 210096, Peoples R China

Wen, Guanghui
论文数: 0 引用数: 0
h-index: 0
机构:
Southeast Univ, Sch Math, Nanjing 210096, Peoples R China Southeast Univ, Sch Math, Nanjing 210096, Peoples R China

Baldi, Simone
论文数: 0 引用数: 0
h-index: 0
机构:
Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
Delft Univ Technol, Delft Ctr Syst & Control, NL-2628 CD Delft, Netherlands Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[7]
Deep-Reinforcement-Learning-Based Autonomous Voltage Control for Power Grid Operations
[J].
Duan, Jiajun
;
Shi, Di
;
Diao, Ruisheng
;
Li, Haifeng
;
Wang, Zhiwei
;
Zhang, Bei
;
Bian, Desong
;
Yi, Zhehan
.
IEEE TRANSACTIONS ON POWER SYSTEMS,
2020, 35 (01)
:814-817

Duan, Jiajun
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA

Shi, Di
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA

Diao, Ruisheng
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA

Li, Haifeng
论文数: 0 引用数: 0
h-index: 0
机构:
State Grid Jiangsu Elect Power Co, Nanjing 210024, Peoples R China GEIRI North Amer, San Jose, CA 95134 USA

Wang, Zhiwei
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA

Zhang, Bei
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA

Bian, Desong
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA

Yi, Zhehan
论文数: 0 引用数: 0
h-index: 0
机构:
GEIRI North Amer, San Jose, CA 95134 USA GEIRI North Amer, San Jose, CA 95134 USA
[8]
Optimal Rescheduling of Generators for Congestion Management Based on Particle Swarm Optimization
[J].
Dutta, Sudipta
;
Singh, S. P.
.
IEEE TRANSACTIONS ON POWER SYSTEMS,
2008, 23 (04)
:1560-1569

Dutta, Sudipta
论文数: 0 引用数: 0
h-index: 0
机构:
Banaras Hindu Univ, Inst Technol, Dept Elect Engn, Varanasi 221005, Uttar Pradesh, India Banaras Hindu Univ, Inst Technol, Dept Elect Engn, Varanasi 221005, Uttar Pradesh, India

论文数: 引用数:
h-index:
机构:
[9]
Contingency Ranking With Respect to Overloads in Very Large Power Systems Taking Into Account Uncertainty, Preventive, and Corrective Actions
[J].
Fliscounakis, Stephane
;
Panciatici, Patrick
;
Capitanescu, Florin
;
Wehenkel, Louis
.
IEEE TRANSACTIONS ON POWER SYSTEMS,
2013, 28 (04)
:4909-4917

Fliscounakis, Stephane
论文数: 0 引用数: 0
h-index: 0
机构:
DMA RTE, Versailles, France DMA RTE, Versailles, France

Panciatici, Patrick
论文数: 0 引用数: 0
h-index: 0
机构:
DMA RTE, Versailles, France DMA RTE, Versailles, France

Capitanescu, Florin
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Luxembourg, Interdisciplinary Ctr Secur Reliabil & Trust SnT, L-1359 Luxembourg, Luxembourg DMA RTE, Versailles, France

Wehenkel, Louis
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Liege, Dept Elect Engn & Comp Sci, B-4000 Liege, Belgium DMA RTE, Versailles, France
[10]
Hybrid Deep Learning for Dynamic Total Transfer Capability Control
[J].
Gao, Qiu
;
Liu, Youbo
;
Zhao, Junbo
;
Liu, Junyong
;
Chung, Chi Yung
.
IEEE TRANSACTIONS ON POWER SYSTEMS,
2021, 36 (03)
:2733-2736

Gao, Qiu
论文数: 0 引用数: 0
h-index: 0
机构:
Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China

Liu, Youbo
论文数: 0 引用数: 0
h-index: 0
机构:
Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China

Zhao, Junbo
论文数: 0 引用数: 0
h-index: 0
机构:
Mississippi State Univ, Elect & Comp Engn, Mississippi State, MS 39762 USA Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China

Liu, Junyong
论文数: 0 引用数: 0
h-index: 0
机构:
Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China

Chung, Chi Yung
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Saskatchewan, Dept Elect & Comp Engn, Saskatoon, SK S7N 5A9, Canada Sichuan Univ, Sch Elect Engn & Informat Technol, Chengdu 610065, Peoples R China