A new self-learning optimal control laws for a class of discrete-time nonlinear systems based on ESN architecture

被引：0
作者：
SONG RuiZhuo [1 ]
XIAO WenDong [1 ]
SUN ChangYin [1 ]
机构：
[1] School of Automation and Electrical Engineering,University of Science and Technology Beijing
来源：
ScienceChina(InformationSciences) | 2014年 / 57卷 / 06期
基金：
中国博士后科学基金; 北京市自然科学基金; 中国国家自然科学基金;
关键词：
adaptive dynamic programming; discrete-time; optimal control; ESN; costate function;
D O I：
暂无
中图分类号：
TP13 [自动控制理论];
学科分类号：
0711 ; 071102 ; 0811 ; 081101 ; 081103 ;
摘要：
A novel self-learning optimal control method for a class of discrete-time nonlinear systems is proposed based on iteration adaptive dynamic programming(ADP)algorithm.It is proven that the iteration costate functions converge to the optimal one,and a detailed convergence analysis of the iteration ADP algorithm is given.Furthermore,echo state network(ESN)architecture is used as the approximator of the costate function for each iteration.To ensure the reliability of the ESN approximator,the ESN mean square training error is constrained in the satisfactory range.Two simulation examples are given to demonstrate that the proposed control method has a fast response speed due to the special structure and the fast training process.
引用
收藏
页码：284 / 293
页数：10
相关论文
共 50 条
  • [41] An optimal Control regulator for nonlinear discrete-time systems with input delays
    Wang, Hai-Hong
    Hu, Nai-Ping
    Zhang, Bao-Lin
    2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 5540 - +
  • [42] Optimal guaranteed cost control of discrete-time uncertain nonlinear systems
    Savkin, AV
    Petersen, IR
    SYSTEM STRUCTURE AND CONTROL 1995, 1996, : 211 - 216
  • [43] Optimal control for discrete-time systems with actuator saturation
    Lin, Qiao
    Wei, Qinglai
    Zhao, Bo
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2017, 38 (06) : 1071 - 1080
  • [44] Neural network optimal control for discrete-time nonlinear systems with known internal dynamics
    Tymoshchuk, Pavlo
    NEURAL COMPUTING & APPLICATIONS, 2024, 36 (08) : 4421 - 4434
  • [45] Predication-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate
    WEI Chen & CHEN ZongJi School of Automation Science and Electrical Engineer
    Science in China(Series F:Information Sciences), 2008, (05) : 524 - 534
  • [46] Prediction-based adaptive control of a class of discrete-time nonlinear systems with nonlinear growth rate
    Wei Chen
    Chen ZongJi
    Science in China Series F: Information Sciences, 2008, 51 : 524 - 534
  • [47] Stable Iterative Optimal Control for Discrete-Time Nonlinear Systems Using Numerical Controller
    Wei, Qinglai
    Liu, Derong
    2013 IEEE INTERNATIONAL CONFERENCE ON VEHICULAR ELECTRONICS AND SAFETY (ICVES), 2013, : 185 - 188
  • [48] Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming
    Chunbin Qin
    Huaguang Zhang
    Yanhong Luo
    Neural Computing and Applications, 2014, 24 : 531 - 538
  • [49] Neural network optimal control for discrete-time nonlinear systems with known internal dynamics
    Pavlo Tymoshchuk
    Neural Computing and Applications, 2024, 36 : 4421 - 4434
  • [50] Optimal tracking control of a class of nonlinear discrete-time switched systems using adaptive dynamic programming
    Qin, Chunbin
    Zhang, Huaguang
    Luo, Yanhong
    NEURAL COMPUTING & APPLICATIONS, 2014, 24 (3-4) : 531 - 538
12345