Multi-Objective Controller Design for Grid-Following Converters With Easy Transfer Reinforcement Learning

被引:10
作者
Zeng, Yu [1 ]
Jiang, Shan [2 ]
Konstantinou, Georgios [2 ]
Pou, Josep [3 ]
Zou, Guibin [4 ]
Zhang, Xin [5 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] UNSW Sydney, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
[3] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[4] Shandong Univ, Sch Elect Engn, Jinan 250061, Peoples R China
[5] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
基金
澳大利亚研究理事会;
关键词
Controller design; deep reinforcement learning (DRL); easy transfer learning (ETL); grid-following (GFL) converter; DISTURBANCE REJECTION CONTROL;
D O I
10.1109/TPEL.2025.3525500
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This article proposes an easy transfer reinforcement learning method that combines easy transfer learning (ETL) with deep reinforcement learning (DRL) to adapt a multiobjective controller tailor-made for one grid-following converter to other converters with different system parameters. The ETRL method contains five stages: system description; DRL learning; ETL; experimental data fine-tuning; and online implementation. The ETRL method can transfer knowledge effectively between controllers, offering a scalable solution for transferring knowledge between different converters without relying on extensive data or hyperparameter tuning. The ETRL method enhances controller adaptability, reduces training requirements by 96.4%, and ensures the stability of converter systems across diverse operating conditions. Experimental results validate the effectiveness of the proposed ETRL method, promising a new direction for power electronics controller design.
引用
收藏
页码:6566 / 6577
页数:12
相关论文
共 31 条
[1]   Power System Stabilization Using Virtual Synchronous Generator With Alternating Moment of Inertia [J].
Alipoor, Jaber ;
Miura, Yushi ;
Ise, Toshifumi .
IEEE JOURNAL OF EMERGING AND SELECTED TOPICS IN POWER ELECTRONICS, 2015, 3 (02) :451-458
[2]   A Data-Driven Fault Diagnosis Methodology in Three-Phase Inverters for PMSM Drive Systems [J].
Cai, Baoping ;
Zhao, Yubin ;
Liu, Hanlin ;
Xie, Min .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2017, 32 (07) :5590-5600
[3]   Q-Learning-based parameters adaptive algorithm for active disturbance rejection control and its application to ship course control [J].
Chen, Zengqiang ;
Qin, Beibei ;
Sun, Mingwei ;
Sun, Qinglin .
NEUROCOMPUTING, 2020, 408 :51-63
[4]   A Novel Nonlinear Deep Reinforcement Learning Controller for DC-DC Power Buck Converters [J].
Gheisarnejad, Meysam ;
Farsizadeh, Hamed ;
Khooban, Mohammad Hassan .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (08) :6849-6858
[5]   IoT-Based DC/DC Deep Learning Power Converter Control: Real-Time Implementation [J].
Gheisarnejad, Meysam ;
Khooban, Mohammad Hassan .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2020, 35 (12) :13621-13630
[6]  
Gong BQ, 2012, PROC CVPR IEEE, P2066, DOI 10.1109/CVPR.2012.6247911
[7]   DC/DC Power Converter Control-Based Deep Machine Learning Techniques: Real-Time Implementation [J].
Hajihosseini, Mojtaba ;
Andalibi, Milad ;
Gheisarnejad, Meysam ;
Farsizadeh, Hamed ;
Khooban, Mohammad-Hassan .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2020, 35 (10) :9971-9977
[8]   Impedance-Based Stability of Grid-Connected DC Distribution Power Systems: AC- and DC-Side Stability Criteria, Equivalence, and Difference [J].
He, Bangbang ;
Chen, Wu ;
Zhang, Chun ;
Yuan, Yubo ;
Zhang, Chenyu .
IEEE JOURNAL OF EMERGING AND SELECTED TOPICS IN POWER ELECTRONICS, 2023, 11 (06) :5842-5852
[9]   Stability-Oriented Multiobjective Control Design for Power Converters Assisted by Deep Reinforcement Learning [J].
Jiang, Shan ;
Zeng, Yu ;
Zhu, Ye ;
Pou, Josep ;
Konstantinou, Georgios .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2023, 38 (10) :12394-12400
[10]   Settling Angle-Based Stability Criterion for Power-Electronics-Dominated Power Systems [J].
Jiang, Shan ;
Zhu, Ye ;
Konstantinou, Georgios .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2023, 38 (03) :2972-2984