Near Optimal Event-Triggered Control of Nonlinear Discrete-Time Systems Using Neurodynamic Programming

被引:114
作者
Sahoo, Avimanyu [1 ]
Xu, Hao [2 ]
Jagannathan, Sarangapani [1 ]
机构
[1] Missouri Univ Sci & Technol, Dept Elect & Comp Engn, Rolla, MO 65409 USA
[2] Texas A&M Univ, Dept Elect Engn, Coll Sci & Engn, Corpus Christi, TX 78412 USA
基金
美国国家科学基金会;
关键词
Event-triggered control (ETC); Hamilton-Jacobi-Bellman equation; neural networks (NNs); neurodynamic programming (NDP); optimal control;
D O I
10.1109/TNNLS.2015.2453320
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an event-triggered near optimal control of uncertain nonlinear discrete-time systems. Event-driven neurodynamic programming (NDP) is utilized to design the control policy. A neural network (NN)-based identifier, with event-based state and input vectors, is utilized to learn the system dynamics. An actor-critic framework is used to learn the cost function and the optimal control input. The NN weights of the identifier, the critic, and the actor NNs are tuned aperiodically once every triggered instant. An adaptive event-trigger condition to decide the trigger instants is derived. Thus, a suitable number of events are generated to ensure a desired accuracy of approximation. A near optimal performance is achieved without using value and/or policy iterations. A detailed analysis of nontrivial inter-event times with an explicit formula to show the reduction in computation is also derived. The Lyapunov technique is used in conjunction with the event-trigger condition to guarantee the ultimate boundedness of the closed-loop system. The simulation results are included to verify the performance of the controller. The net result is the development of event-driven NDP.
引用
收藏
页码:1801 / 1815
页数:15
相关论文
共 22 条
  • [11] Finite-Approximation-Error-Based Optimal Control Approach for Discrete-Time Nonlinear Systems
    Liu, Derong
    Wei, Qinglai
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (02) : 779 - 789
  • [12] Liu J, 2013, PROCEEDINGS OF THE 2013 INTERNATIONAL CONFERENCE ON ENERGY, P16, DOI 10.1109/AMS.2013.9
  • [13] On the Optimality of Certainty Equivalence for Event-Triggered Control Systems
    Molin, Adam
    Hirche, Sandra
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2013, 58 (02) : 470 - 474
  • [14] GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming
    Ni, Zhen
    He, Haibo
    Zhao, Dongbin
    Xu, Xin
    Prokhorov, Danil V.
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (03) : 614 - 627
  • [15] Sahoo A, 2013, IEEE INT SYMP INTELL, P35, DOI 10.1109/ISIC.2013.6658613
  • [16] Sahoo A, 2013, P AMER CONTR CONF, P6418
  • [17] Event-triggered real-time scheduling of stabilizing control tasks
    Tabuada, Paulo
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2007, 52 (09) : 1680 - 1685
  • [18] On event design in event-triggered feedback systems
    Wang, Xiaofeng
    Lemmon, Michael
    [J]. AUTOMATICA, 2011, 47 (10) : 2319 - 2322
  • [19] Infinite Horizon Self-Learning Optimal Control of Nonaffine Discrete-Time Nonlinear Systems
    Wei, Qinglai
    Liu, Derong
    Yang, Xiong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (04) : 866 - 879
  • [20] Data-Driven Neuro-Optimal Temperature Control of Water-Gas Shift Reaction Using Stable Iterative Adaptive Dynamic Programming
    Wei, Qinglai
    Liu, Derong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2014, 61 (11) : 6399 - 6408