A new self-learning optimal control laws for a class of discrete-time nonlinear systems based on ESN architecture

被引：0
|
作者：
SONG RuiZhuo [1 ]
XIAO WenDong [1 ]
SUN ChangYin [1 ]
机构：
[1] School of Automation and Electrical Engineering,University of Science and Technology Beijing
来源：
Science China(Information Sciences) | 2014年 / 57卷 / 06期
基金：
中国博士后科学基金; 中国国家自然科学基金; 北京市自然科学基金;
关键词：
adaptive dynamic programming; discrete-time; optimal control; ESN; costate function;
D O I：
暂无
中图分类号：
TP13 [自动控制理论];
学科分类号：
0711 ; 071102 ; 0811 ; 081101 ; 081103 ;
摘要：
A novel self-learning optimal control method for a class of discrete-time nonlinear systems is proposed based on iteration adaptive dynamic programming(ADP)algorithm.It is proven that the iteration costate functions converge to the optimal one,and a detailed convergence analysis of the iteration ADP algorithm is given.Furthermore,echo state network(ESN)architecture is used as the approximator of the costate function for each iteration.To ensure the reliability of the ESN approximator,the ESN mean square training error is constrained in the satisfactory range.Two simulation examples are given to demonstrate that the proposed control method has a fast response speed due to the special structure and the fast training process.
引用
收藏
页码：284 / 293
页数：10
相关论文
共 50 条
  • [31] On Quadratic Optimal Control of Nonlinear Discrete-Time Systems
    Elloumi, Salwa
    Mechichi, Amina Khiari
    Braiek, Naceur Benhadj
    2013 10TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD), 2013,
  • [32] Discrete-Time Synergetic Optimal Control of Nonlinear Systems
    Nusawardhana, R.
    Zak, S. H.
    Crossley, W. A.
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2008, 31 (06) : 1561 - 1574
  • [33] Adaptive Iterative Learning Control for a Class of MIMO Discrete-Time Nonlinear Systems
    Liu, Baobin
    Zhou, Wei
    2016 11TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION (ICCSE), 2016, : 832 - 838
  • [34] A Discrete-Time Stochastic Iterative Learning Control Algorithm for a Class of Nonlinear Systems
    Saab, S. S.
    CONTROL AND INTELLIGENT SYSTEMS, 2005, 33 (02) : 95 - 101
  • [35] An optimal terminal iterative learning control approach for nonlinear discrete-time systems
    Chi, R.-H. (ronghu_chi@hotmail.com), 2012, South China University of Technology (29):
  • [36] Optimal Tracking Control for a Class of Nonlinear Discrete-Time Systems with Time Delays Based on Heuristic Dynamic Programming
    Zhang, Huaguang
    Song, Ruizhuo
    Wei, Qinglai
    Zhang, Tieyan
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (12): : 1851 - 1862
  • [37] Approximate Optimal Tracking Control for a Class of Discrete-time Nonlinear Systems based on GDHP Iterative Algorithm
    Tan, Xufeng
    Li, Yuan
    Liu, Yang
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1932 - 1937
  • [38] Iterative GDHP-based approximate optimal tracking control for a class of discrete-time nonlinear systems
    Mu, Chaoxu
    Sun, Changyin
    Song, Aiguo
    Yu, Hualong
    NEUROCOMPUTING, 2016, 214 : 775 - 784
  • [39] Optimal dissipative control of a class of discrete-time nonlinear stochastic systems with general criteria
    Yaz, EE
    Yaz, YI
    EUROPEAN JOURNAL OF CONTROL, 2002, 8 (05) : 445 - 452
  • [40] A New Optimal Control Method for Discrete-Time Nonlinear Systems with Approximation Error
    Wei, Qinglai
    Liu, Derong
    PROCEEDINGS OF THE 10TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA 2012), 2012, : 185 - 190
12345