A Time-Varying Deep Reinforcement Model Predictive Control for DC Power Converter Systems

被引:16
作者
Andalibi, Milad [1 ]
Hajihosseini, Mojtaba [2 ]
Teymoori, Sam [3 ]
Kargar, Maryam [4 ]
Gheisarnejad, Meysam [5 ]
机构
[1] Shiraz Univ, Dept Elect & Comp Engn, Shiraz, Iran
[2] Aarhus Univ, Dept Dept Engn Appl Formal Methods, Aarhus, Denmark
[3] UCSC, Dept Elect & Comp Engn, Santa Cruz, CA USA
[4] Islamic Azad Univ, West Tehran Branch, Dept Elect & Comp Engn, Tehran, Iran
[5] Islamic Azad Univ, Dept Elect Engn, Najafabad, Iran
来源
2021 IEEE 12TH INTERNATIONAL SYMPOSIUM ON POWER ELECTRONICS FOR DISTRIBUTED GENERATION SYSTEMS (PEDG) | 2021年
关键词
DC-DC Buck-Boost Converter; Constant Power Load (CPL); Adaptive Model Predictive Control (AMPC); Deep Reinforcement Learning (DRL);
D O I
10.1109/PEDG51384.2021.9494214
中图分类号
TE [石油、天然气工业]; TK [能源与动力工程];
学科分类号
0807 ; 0820 ;
摘要
Today power converters, especially DC/DC converters, is of great importance in power electronics applications such as DC micro-grids (MGs). However, they have some limitation such as inability to handle constant power load (CPL) which results in instability problems in MGs. Thus, a controller with specific characters including, robustness and fast response to system dynamic is vital to address the unsteadiness. In this paper, an adaptive model prediction controller (AMPC) based on Deep Reinforcement Learning (DRL) is developed to tackle the de-stabilization problem. In the proposed AMPC controller, the controlling signal coefficient in each variable operation point is regarded as the adjustable controller parameter and adaptively designed by the learning ability of the Deep Q- Network (DQN) strategy, leading to a robust controlling approach. We have shown that our suggested smart controller for DC/DC converters feeding CPLs is robust and fast in dynamic response.
引用
收藏
页数:6
相关论文
共 18 条
[1]  
Soriano--Rangel CA, 2019, Arxiv, DOI arXiv:1909.04438
[2]  
Andalibi M, 2020, IEEE INT SYMP POWER, P276, DOI [10.1109/pedg48541.2020.9244399, 10.1109/PEDG48541.2020.9244399]
[3]  
Camacho EF, 2007, LECT NOTES CONTR INF, V358, P1
[4]  
Domahidi A, 2011, IEEE DECIS CONTR P, P513, DOI 10.1109/CDC.2011.6161258
[5]   DC/DC Power Converter Control-Based Deep Machine Learning Techniques: Real-Time Implementation [J].
Hajihosseini, Mojtaba ;
Andalibi, Milad ;
Gheisarnejad, Meysam ;
Farsizadeh, Hamed ;
Khooban, Mohammad-Hassan .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2020, 35 (10) :9971-9977
[6]   Stability Analysis and Controller Design of DC Microgrids With Constant Power Loads [J].
Herrera, Luis ;
Zhang, Wei ;
Wang, Jin .
IEEE TRANSACTIONS ON SMART GRID, 2017, 8 (02) :881-888
[7]   Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing [J].
Huang, Liang ;
Feng, Xu ;
Zhang, Cheng ;
Qian, Liping ;
Wu, Yuan .
DIGITAL COMMUNICATIONS AND NETWORKS, 2019, 5 (01) :10-17
[8]  
Jafari Hassan., 2012, Iranian Conference on Smart Grids, P1
[9]   Direct Voltage Control of DC-DC Boost Converters Using Enumeration-Based Model Predictive Control [J].
Karamanakos, Petros ;
Geyer, Tobias ;
Manias, Stefanos .
IEEE TRANSACTIONS ON POWER ELECTRONICS, 2014, 29 (02) :968-978
[10]   Design of Quadratic D-Stable Fuzzy Controller for DC Microgrids With Multiple CPLs [J].
Mardani, Mohammad Mehdi ;
Vafamand, Navid ;
Khooban, Mohammad Hassan ;
Dragicevic, Tomislav ;
Blaabjerg, Frede .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (06) :4805-4812