Combining hybrid metaheuristic algorithms and reinforcement learning to improve the optimal control of nonlinear continuous-time systems with input constraints

被引:2
作者
Amirabadi, Roya Khalili [1 ]
Fard, Omid Solaymani [1 ]
机构
[1] Ferdowsi Univ Mashhad, Fac Math Sci, Dept Appl Math, Mashhad, Iran
关键词
Optimal tracking control; Reinforcement learning; Actor-critic neural network; Hybrid metaheuristic algorithms; Nonlinear systems; OPTIMAL TRACKING CONTROL;
D O I
10.1016/j.compeleceng.2024.109179
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes an innovative method for achieving optimal tracking control in nonlinear continuous -time systems with input constraints. The method combines reinforcement learning and hybrid metaheuristics to enhance the controller's performance. Specifically, a hybrid metaheuristic algorithm is employed to optimize the hyperparameters of a critic neural network, which serves as the system's controller. The proposed approach is evaluated through extensive simulation studies on a nonlinear system with input constraints. Results demonstrate its superiority over traditional control techniques in terms of accuracy, timeliness, and stability. Notably, the approach effectively eliminates overshoot and steady-state error while providing precise and prompt tracking and showcasing remarkable robustness against model uncertainties. By synergistically integrating reinforcement learning and hybrid metaheuristics, this approach represents a significant advancement in enhancing the control performance of complex nonlinear systems. The simulation studies confirm superiority of the proposed approach over existing techniques, offering a promising solution for achieving optimal tracking control in nonlinear systems with input constraints. This approach holds potential for a wide range of applications, including robotics, aerospace, and manufacturing, where precise and prompt tracking control is critical.
引用
收藏
页数:17
相关论文
共 28 条
[1]  
Abdel-Basset M., 2018, COMPUTATIONAL INTELL, P185, DOI [DOI 10.1016/B978-0-12-813314-9.00010-4, DOI 10.1016/B978-0-12-813314-9.00010-4.Z.B.T.-C.I]
[2]  
Beheshti Z., 2013, Int. J. Adv. Soft Comput. Appl, V5, P1
[3]   A novel metaheuristic optimizer inspired by behavior of jellyfish in ocean [J].
Chou, Jui-Sheng ;
Truong, Dinh-Nhat .
APPLIED MATHEMATICS AND COMPUTATION, 2021, 389
[4]   A survey on new generation metaheuristic algorithms [J].
Dokeroglu, Tansel ;
Sevinc, Ender ;
Kucukyilmaz, Tayfun ;
Cosar, Ahmet .
COMPUTERS & INDUSTRIAL ENGINEERING, 2019, 137
[5]   Implementing the Nelder-Mead simplex algorithm with adaptive parameters [J].
Gao, Fuchang ;
Han, Lixing .
COMPUTATIONAL OPTIMIZATION AND APPLICATIONS, 2012, 51 (01) :259-277
[6]   Learning-based adaptive optimal output regulation of linear and nonlinear systems: an overview [J].
Gao, Weinan ;
Jiang, Zhong-Ping .
CONTROL THEORY AND TECHNOLOGY, 2022, 20 (01) :1-19
[7]   Optimal control of nonlinear systems with input constraints using linear time varying approximations [J].
Itik, Mehmet .
NONLINEAR ANALYSIS-MODELLING AND CONTROL, 2016, 21 (03) :400-412
[8]  
Jalaeian FM, 2012, IEEE INT CONF FUZZY
[9]   Bi-Level Adaptive Computed-Current Impedance Controller for Electrically Driven Robots [J].
Jalaeian-F, Mohsen ;
Fateh, Mohammad Mehdi ;
Rahimiyan, Morteza .
ROBOTICA, 2021, 39 (02) :200-216
[10]  
Khalil H.K., 2002, Nonlinear Systems, V3rd