Distribution Network Expansion-Friendly Adaptive Deep Reinforcement Learning for Inverter-Based Volt-Var Control

被引:0
作者
Zhao, Yu [1 ]
Liu, Jun [1 ]
Liu, Xiaoming [1 ]
Nie, Yongxin [1 ]
Ding, Tao [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect Engn, Xian 710049, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; Volt-Var control; distribution network expansion; fine-tuning;
D O I
10.1109/TSG.2025.3564105
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, in response to the challenges posed by the volatility and uncertainty of increasing renewable energy sources (RESs), numerous studies have emerged on inverter-based Volt-Var control (VVC) using data-driven deep reinforcement learning (DRL) methods. However, most of these methods assume fixed distribution network (DN) scales, which may not be applicable under potential DN expansion involving newly connected nodes and controllable devices. To address this issue, this letter proposes a novel DRL framework for inverter-based VVC capable of adapting to evolving DN environments. Specifically, state embedding for expanding state space (SE-ESS) and action branching for expanding action space (AB-EAS) are designed to facilitate model fine-tuning for the expansion of DN scales. Case studies on a modified IEEE 33-bus system validate the proposed method's strong adaptability to DN expansion.
引用
收藏
页码:3461 / 3464
页数:4
相关论文
共 17 条
[1]   NETWORK RECONFIGURATION IN DISTRIBUTION-SYSTEMS FOR LOSS REDUCTION AND LOAD BALANCING [J].
BARAN, ME ;
WU, FF .
IEEE TRANSACTIONS ON POWER DELIVERY, 1989, 4 (02) :1401-1407
[2]   Optimal Placement of PV Smart Inverters With Volt-VAr Control in Electric Distribution Systems [J].
Chen, Mengxi ;
Ma, Shanshan ;
Soltani, Zahra ;
Ayyanar, Raja ;
Vittal, Vijay ;
Khorsand, Mojdeh .
IEEE SYSTEMS JOURNAL, 2023, 17 (03) :3436-3446
[3]   Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges [J].
Chen, Xin ;
Qu, Guannan ;
Tang, Yujie ;
Low, Steven ;
Li, Na .
IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (04) :2935-2958
[4]  
Haarnoja T, 2017, PR MACH LEARN RES, V70
[5]  
Haarnoja T, 2018, PR MACH LEARN RES, V80
[6]   Distribution network expansion planning and DG placement in the presence of uncertainties [J].
Hemmati, Reza ;
Hooshmand, Rahmat-Allah ;
Taheri, Nabi .
INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2015, 73 :665-673
[7]  
Jain A., 2020, P INT C MACH LEARN, P1
[8]  
Hamilton WL, 2018, Arxiv, DOI [arXiv:1706.02216, 10.48550/arXiv.1706.02216]
[9]  
Lillicrap T.P., 2015, MACHINE LEARNING
[10]   Distribution network expansion planning: An updated review of current methods and new challenges [J].
Rastgou, Abdollah .
RENEWABLE & SUSTAINABLE ENERGY REVIEWS, 2024, 189