A new self-learning optimal control laws for a class of discrete-time nonlinear systems based on ESN architecture

被引：0
|
作者：
SONG RuiZhuo [1 ]
XIAO WenDong [1 ]
SUN ChangYin [1 ]
机构：
[1] School of Automation and Electrical Engineering,University of Science and Technology Beijing
来源：
Science China(Information Sciences) | 2014年 / 57卷 / 06期
基金：
中国博士后科学基金; 中国国家自然科学基金; 北京市自然科学基金;
关键词：
adaptive dynamic programming; discrete-time; optimal control; ESN; costate function;
D O I：
暂无
中图分类号：
TP13 [自动控制理论];
学科分类号：
0711 ; 071102 ; 0811 ; 081101 ; 081103 ;
摘要：
A novel self-learning optimal control method for a class of discrete-time nonlinear systems is proposed based on iteration adaptive dynamic programming(ADP)algorithm.It is proven that the iteration costate functions converge to the optimal one,and a detailed convergence analysis of the iteration ADP algorithm is given.Furthermore,echo state network(ESN)architecture is used as the approximator of the costate function for each iteration.To ensure the reliability of the ESN approximator,the ESN mean square training error is constrained in the satisfactory range.Two simulation examples are given to demonstrate that the proposed control method has a fast response speed due to the special structure and the fast training process.
引用
收藏
页码：284 / 293
页数：10
相关论文
共 50 条
  • [21] Finite Horizon Optimal Tracking Control for a Class of Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Wang, Ding
    Liu, Derong
    ADVANCES IN NEURAL NETWORKS - ISNN 2011, PT II, 2011, 6676 : 620 - 629
  • [22] Online Optimal Adaptive Control of a Class of Uncertain Nonlinear Discrete-time Systems
    Moghadam, Rohollah
    Natarajan, Pappa
    Raghavan, Krishnan
    Jagannathan, Sarangapani
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [23] Approximate optimal control for a class of nonlinear discrete-time systems with saturating actuators
    Luo, Yanhong
    Zhang, Huaguang
    PROGRESS IN NATURAL SCIENCE-MATERIALS INTERNATIONAL, 2008, 18 (08) : 1023 - 1029
  • [24] Inverse optimal neural control for a class of discrete-time nonlinear positive systems
    Leon, Blanca S.
    Alanis, Alma Y.
    Sanchez, Edgar N.
    Ruiz-Velazquez, Eduardo
    Ornelas-Tellez, Fernando
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2012, 26 (07) : 614 - 629
  • [25] Optimal control of a particular class of singularly perturbed nonlinear discrete-time systems
    Bouyekhf, R
    El Hami, A
    El Moudni, A
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2001, 46 (07) : 1097 - 1101
  • [26] Adaptive control of a class of nonlinear discrete-time systems
    Wang, Q.D.
    Wei, C.L.
    Shao, H.Y.
    Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2001, 21 (09):
  • [27] Adaptive Optimal Control for Nonlinear Discrete-Time Systems
    Qin, Chunbin
    Zhang, Huaguang
    Luo, Yanhong
    PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2013, : 13 - 18
  • [28] Optimal Control of Affine Nonlinear Discrete-time Systems
    Dierks, Travis
    Jagannthan, S.
    MED: 2009 17TH MEDITERRANEAN CONFERENCE ON CONTROL & AUTOMATION, VOLS 1-3, 2009, : 1390 - 1395
  • [29] Optimal discrete-time control for nonlinear cascade systems
    Haddad, WM
    Fausz, JL
    Chellaboina, V
    Abdallah, CT
    PROCEEDINGS OF THE 1997 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 1997, : 2175 - 2176
  • [30] An FNN-Based Adaptive Iterative Learning Control for a Class of Nonlinear Discrete-Time Systems
    Wang, Ying-Chung
    Chien, Chiang-Ju
    2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS & VISION (ICARCV), 2012, : 447 - 451
12345