A Power System Corrective Control Method Based on Evolutionary Reinforcement Learning

被引:1
作者
Zhang, Haoran [1 ]
Xu, Peidong [1 ]
Zhang, Ke [1 ]
Zhao, Hang [1 ]
Dai, Yuxin [1 ]
Gao, Tianlu [1 ]
Zhang, Jun [1 ]
机构
[1] Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China
来源
IEEE JOURNAL OF RADIO FREQUENCY IDENTIFICATION | 2022年 / 6卷
关键词
Corrective control; evolutionary algorithm; reinforcement learning; power network; LINE;
D O I
10.1109/JRFID.2022.3205359
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Corrective control becomes more and more important for power systems due to the increasing penetration of renewable energy. As an effective method in control problems, the Reinforcement learning method is considered to provide decisions for corrective control in power networks. However, the large size of action and state space, as well as the sparse reward problem in corrective control limits the application of the RL method. This paper proposed an evolutionary reinforcement learning method. Combining the evolutionary algorithm and Reinforcement learning methods, this method decreases the training difficulty of reinforcement learning. The experiments based on the Grid2op environment show that the proposed method has a longer operation time than other traditional methods in the corrective control of power networks.
引用
收藏
页码:815 / 819
页数:5
相关论文
共 50 条
[41]   Research on Signal Control Method of Single Intersection Based on Reinforcement Learning [J].
Ren, Yilong ;
Zhang, Le ;
Jiang, Han ;
Liu, Chengsheng .
CICTP 2020: TRANSPORTATION EVOLUTION IMPACTING FUTURE MOBILITY, 2020, :173-184
[42]   A Heuristics-Based Reinforcement Learning Method to Control Bipedal Robots [J].
Qin, Daoling ;
Zhang, Guoteng ;
Zhu, Zhengguo ;
Chen, Teng ;
Zhu, Weiliang ;
Rong, Xuewen ;
Xie, Anhuan ;
Li, Yibin .
INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2024, 21 (03)
[43]   Consensus Based Reinforcement Learning Method for Differentiated Formation Control of UAVs [J].
He, Xingyu ;
Luo, Dongxu ;
Chen, Zekun ;
Yang, Guisong ;
Liu, Yunhuai .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (02) :2429-2442
[44]   A Corrective Control Approach Considering Load Fluctuation of the Power System [J].
Lu, Guo-jun ;
Li, Hang ;
Deng, Wei-si ;
Bie, Pei ;
Zhang, Bu-han ;
Zhang, Zhe ;
Chen, Guo-yan .
2016 INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND AUTOMATION (ICEEA 2016), 2016,
[45]   An Efficient Evaluation Mechanism for Evolutionary Reinforcement Learning [J].
Wu, Xiaoqiang ;
Zhu, Qingling ;
Lin, Qiuzhen ;
Li, Jianqiang ;
Chen, Jianyong ;
Ming, Zhong .
INTELLIGENT COMPUTING THEORIES AND APPLICATION (ICIC 2022), PT I, 2022, 13393 :41-50
[46]   Reinforcement Learning Performance Evaluation: An Evolutionary Approach [J].
Capi, Genci ;
Yokota, Masao .
INTELLIGENT AUTONOMOUS SYSTEMS 9, 2006, :416-+
[47]   Reinforcement learning based metric filtering for evolutionary distance metric learning [J].
Ali, Bassel ;
Moriyama, Koichi ;
Kalintha, Wasin ;
Numao, Masayuki ;
Fukui, Ken-Ichi .
INTELLIGENT DATA ANALYSIS, 2020, 24 (06) :1345-1364
[48]   Application of reinforcement learning to power system operation [J].
Takayama S. .
IEEJ Transactions on Power and Energy, 2021, 141 (10) :608-611
[49]   Reinforcement learning in a distributed market-based production control system [J].
Csaji, Balazs Csanad ;
Monostori, Laszlo ;
Kadar, Botond .
ADVANCED ENGINEERING INFORMATICS, 2006, 20 (03) :279-288
[50]   Joint Power Control and Channel Allocation for Interference Mitigation Based on Reinforcement Learning [J].
Zhao, Guofeng ;
Li, Yong ;
Xu, Chuan ;
Han, Zhenzhen ;
Xing, Yuan ;
Yu, Shui .
IEEE ACCESS, 2019, 7 :177254-177265