Iterative GDHP-based approximate optimal tracking control for a class of discrete-time nonlinear systems

被引:43
|
作者
Mu, Chaoxu [1 ,2 ]
Sun, Changyin [2 ]
Song, Aiguo [3 ]
Yu, Hualong [2 ]
机构
[1] Tianjin Univ, Sch Elect Engn & Automat, Tianjin Key Lab Proc Measurement & Control, Tianjin 300072, Peoples R China
[2] Southeast Univ, Sch Automat, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Dept Instrument Sci & Engn, Nanjing 210096, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Adaptive dynamic programming (ADP); Approximate optimal tracking control; Globalized dual heuristic programming (GDHP); Neural networks; Nonlinear systems; ADAPTIVE CRITIC DESIGNS; NEURAL-NETWORKS; REINFORCEMENT; REGRESSION; ALGORITHM;
D O I
10.1016/j.neucom.2016.06.059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, an iterative globalized dual heuristic programming (GDHP) method is developed to deal with the approximate optimal tracking control for a class of discrete-time nonlinear systems. The optimal tracking control problem is formulated by solving the discrete-time Hamilton-Jacobi-Bellman (DTHJB) equation. Then, it is approximately solved by the developed iterative GDHP-based algorithm with convergence analysis. The iterative GDHP algorithm is implemented by constructing three neural networks to approximate the error system dynamics, the cost function with its derivative, and the control policy in each iteration, respectively. The information of the cost function and its derivative is provided during iteration calculation. Two simulation examples are investigated to verify the performance of the proposed approximate optimal tracking control approach. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:775 / 784
页数:10
相关论文
共 50 条
  • [1] Approximate Optimal Tracking Control for a Class of Discrete-time Nonlinear Systems based on GDHP Iterative Algorithm
    Tan, Xufeng
    Li, Yuan
    Liu, Yang
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1932 - 1937
  • [2] Neural-Network-Based Optimal Control for a Class of Nonlinear Discrete-Time Systems With Control Constraints Using the Iterative GDHP Algorithm
    Liu, Derong
    Wang, Ding
    Zhao, Dongbin
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 53 - 60
  • [3] Approximate optimal output tracking control for nonlinear discrete-time systems
    Tang, Gong-You
    Liu, Yi-Min
    Zhang, Yong
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2010, 27 (03): : 400 - 405
  • [4] Approximate optimal control for a class of nonlinear discrete-time systems with saturating actuators
    Luo, Yanhong
    Zhang, Huaguang
    PROGRESS IN NATURAL SCIENCE-MATERIALS INTERNATIONAL, 2008, 18 (08) : 1023 - 1029
  • [6] Finite Horizon Optimal Tracking Control for a Class of Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Wang, Ding
    Liu, Derong
    ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT II, 2011, 6676 : 620 - 629
  • [7] Approximate Optimal tracking Control for Nonlinear Discrete-time Switched Systems via Approximate Dynamic Programming
    Qin, Chunbin
    Huang, Yizhe
    Yang, Yabin
    Zhang, Jishi
    Liu, Xianxing
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 1456 - 1461
  • [8] Optimal Iterative Learning Control for Nonlinear Discrete-Time Systems
    Xu, Hong-wei
    SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING: THEORY AND PRACTICE, VOL 2, 2012, 115 : 69 - 75
  • [9] Optimal Iterative Learning Control for Nonlinear Discrete-time Systems
    Xu Hong-wei
    KEY ENGINEERING MATERIALS AND COMPUTER SCIENCE, 2011, 320 : 605 - 609
  • [10] Optimal Control of Unknown Discrete-Time Nonlinear Systems with Constrained Inputs Using GDHP Technique
    Liu Derong
    Wang Ding
    Li Hongliang
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 2926 - 2931