Machine learning model-based optimal tracking control of nonlinear affine systems with safety constraints

被引:0
|
作者
Wang, Yujia [1 ]
Wu, Zhe [1 ]
机构
[1] Natl Univ Singapore, Dept Chem & Biomol Engn, Singapore, Singapore
关键词
control Lyapounov barrier function; control-affine systems; machine learning; safe reinforcement learning; PREDICTIVE CONTROL; ROBUST-CONTROL;
D O I
10.1002/rnc.7659
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work focuses on the development of a machine learning (ML) model-based framework for safe optimal tracking control of a class of nonlinear control-affine systems to ensure simultaneous closed-loop stability and safety. Specifically, a novel multilayer feedforward neural network (FNN) with a control-affine architecture is designed to model nonlinear dynamic systems. Subsequently, a model-based reinforcement learning (RL) framework is presented, utilizing a novel cost function with Control Lyapunov-Barrier Function (CLBF) properties, to learn both the control policy and the optimal value function for an infinite-horizon optimal tracking control problem for nonlinear systems with safety constraints. The efficacy of the proposed methodology is demonstrated through simulations of a one-link robot manipulator and a chemical process example.
引用
收藏
页码:511 / 535
页数:25
相关论文
共 50 条
  • [1] Safe model-based reinforcement learning for nonlinear optimal control with state and input constraints
    Kim, Yeonsoo
    Kim, Jong Woo
    AICHE JOURNAL, 2022, 68 (05)
  • [2] Tracking control of nonlinear systems by fuzzy model-based controller
    Kung, CC
    Li, HH
    PROCEEDINGS OF THE SIXTH IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS I - III, 1997, : 623 - 628
  • [3] Optimal Learning Tracking Control for Nonlinear Systems
    Tsai, J. S. H.
    Chen, G. R.
    Lin, C. Y.
    Guo, S. M.
    Tsai, T. -J.
    WMSCI 2008: 12TH WORLD MULTI-CONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL IV, PROCEEDINGS, 2008, : 99 - +
  • [4] Robust relatively optimal trajectory tracking control for a class of uncertain nonlinear control affine systems with state and input constraints
    Nidya, M., V
    Mija, S. J.
    Jeevamma, Jacob
    NONLINEAR DYNAMICS, 2022, 110 (04) : 3513 - 3534
  • [5] Robust relatively optimal trajectory tracking control for a class of uncertain nonlinear control affine systems with state and input constraints
    M. V. Nidya
    S. J. Mija
    Jacob Jeevamma
    Nonlinear Dynamics, 2022, 110 : 3513 - 3534
  • [6] Model-based reinforcement learning for output-feedback optimal control of a class of nonlinear systems
    Self, Ryan
    Harlan, Michael
    Kamalapurkar, Rushikesh
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 2378 - 2383
  • [7] On the optimal control of affine nonlinear systems
    Popescu, M
    Dumitrache, A
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2005, (04) : 465 - 475
  • [8] A model-based deep reinforcement learning method applied to finite-horizon optimal control of nonlinear control-affine system
    Kim, Jong Woo
    Park, Byung Jun
    Yoo, Haeun
    Oh, Tae Hoon
    Lee, Jay H.
    Lee, Jong Min
    JOURNAL OF PROCESS CONTROL, 2020, 87 (87) : 166 - 178
  • [9] Optimal control for a class of nonlinear systems with input constraints based on reinforcement learning
    Luo A.
    Xiao W.-B.
    Zhou Q.
    Lu R.-Q.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2022, 39 (01): : 154 - 164
  • [10] Lifelong Learning-Based Optimal Trajectory Tracking Control of Constrained Nonlinear Affine Systems Using Deep Neural Networks
    Ganie, Irfan
    Jagannathan, Sarangapani
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (12) : 7133 - 7146