Near Optimal Event-Triggered Control of Nonlinear Discrete-Time Systems Using Neurodynamic Programming

被引:114
|
作者
Sahoo, Avimanyu [1 ]
Xu, Hao [2 ]
Jagannathan, Sarangapani [1 ]
机构
[1] Missouri Univ Sci & Technol, Dept Elect & Comp Engn, Rolla, MO 65409 USA
[2] Texas A&M Univ, Dept Elect Engn, Coll Sci & Engn, Corpus Christi, TX 78412 USA
基金
美国国家科学基金会;
关键词
Event-triggered control (ETC); Hamilton-Jacobi-Bellman equation; neural networks (NNs); neurodynamic programming (NDP); optimal control;
D O I
10.1109/TNNLS.2015.2453320
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an event-triggered near optimal control of uncertain nonlinear discrete-time systems. Event-driven neurodynamic programming (NDP) is utilized to design the control policy. A neural network (NN)-based identifier, with event-based state and input vectors, is utilized to learn the system dynamics. An actor-critic framework is used to learn the cost function and the optimal control input. The NN weights of the identifier, the critic, and the actor NNs are tuned aperiodically once every triggered instant. An adaptive event-trigger condition to decide the trigger instants is derived. Thus, a suitable number of events are generated to ensure a desired accuracy of approximation. A near optimal performance is achieved without using value and/or policy iterations. A detailed analysis of nontrivial inter-event times with an explicit formula to show the reduction in computation is also derived. The Lyapunov technique is used in conjunction with the event-trigger condition to guarantee the ultimate boundedness of the closed-loop system. The simulation results are included to verify the performance of the controller. The net result is the development of event-driven NDP.
引用
收藏
页码:1801 / 1815
页数:15
相关论文
共 50 条
  • [1] Event-Triggered Near-Optimal Control for Unknown Discrete-Time Nonlinear Systems Using Parallel Control
    Lu, Jingwei
    Wei, Qinglai
    Zhou, Tianmin
    Wang, Ziyang
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (03) : 1890 - 1904
  • [2] Event-triggered H∞ optimal control for continuous-time nonlinear systems using neurodynamic programming
    Zhao, Jingang
    Gan, Minggang
    Zhang, Chi
    NEUROCOMPUTING, 2019, 360 : 14 - 24
  • [3] Event-Triggered Optimal Parallel Tracking Control for Discrete-Time Nonlinear Systems
    Lu, Jingwei
    Wei, Qinglai
    Liu, Yujia
    Zhou, Tianmin
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (06): : 3772 - 3784
  • [4] Adaptive event-triggered control for nonlinear discrete-time systems
    Hu, Songlin
    Yue, Dong
    Yin, Xiuxia
    Xie, Xiangpeng
    Ma, Yong
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2016, 26 (18) : 4104 - 4125
  • [5] Event-triggered near-optimal tracking control based on adaptive dynamic programming for discrete-time systems
    Wang, Ziyang
    Lee, Joonhyup
    Wei, Qinglai
    Zhang, Anting
    NEUROCOMPUTING, 2023, 537 : 187 - 197
  • [6] Event-Triggered Optimal Control for Discrete-Time Switched Nonlinear Systems With Constrained Control Input
    Han, Xiumei
    Zhao, Xudong
    Sun, Tao
    Wu, Yuhu
    Xu, Ning
    Zong, Guangdeng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (12): : 7850 - 7859
  • [7] Event-triggered Control for Discrete-Time Systems
    Eqtami, Alina
    Dimarogonas, Dimos V.
    Kyriakopoulos, Kostas J.
    2010 AMERICAN CONTROL CONFERENCE, 2010, : 4719 - 4724
  • [8] Adaptive Event-Triggered Control Based on Heuristic Dynamic Programming for Nonlinear Discrete-Time Systems
    Dong, Lu
    Zhong, Xiangnan
    Sun, Changyin
    He, Haibo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (07) : 1594 - 1605
  • [9] An Event-Triggered Heuristic Dynamic Programming Algorithm for Discrete-Time Nonlinear Systems
    Wang, Ziyang
    Wei, Qinglai
    Liu, Derong
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT I, 2017, 10634 : 741 - 748
  • [10] Event-triggered design for discrete-time nonlinear systems with control constraints
    Mu, Chaoxu
    Liao, Kaiju
    Wang, Ke
    NONLINEAR DYNAMICS, 2021, 103 (03) : 2645 - 2657