Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems

被引:252
作者
机构
[1] Center for Control, Dynamicalsystems and Computation (CCDC), University of California, Santa Barbara, 93106-9560, CA
来源
Vamvoudakis, Kyriakos G. (kyriakos@ece.ucsb.edu) | 1600年 / Institute of Electrical and Electronics Engineers Inc.卷 / 01期
关键词
adaptive control; Event-triggered; optimal control; reinforcement learning;
D O I
10.1109/JAS.2014.7004686
中图分类号
学科分类号
摘要
This paper proposes a novel optimal adaptive event-triggered control algorithm for nonlinear continuous-time systems. The goal is to reduce the controller updates, by sampling the state only when an event is triggered to maintain stability and optimality. The online algorithm is implemented based on an actor/critic neural network structure. A critic neural network is used to approximate the cost and an actor neural network is used to approximate the optimal event-triggered controller. Since in the algorithm proposed there are dynamics that exhibit continuous evolutions described by ordinary differential equations and instantaneous jumps or impulses, we will use an impulsive system approach. A Lyapunov stability proof ensures that the closed-loop system is asymptotically stable. Finally, we illustrate the effectiveness of the proposed solution compared to a time-triggered controller. © 2014 IEEE.
引用
收藏
页码:282 / 293
页数:11
相关论文
共 25 条
[21]  
Khalil H.K., Nonlinear Systems, (2002)
[22]  
Vamvoudakis K.G., Lewis F.L., Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem, Automatica, 46, 5, pp. 878-888, (2010)
[23]  
Vrabie D., Vamvoudakis K.G., Lewis F.L., Optimal adaptive control and differential games by reinforcement learning principles, Control Engineering Series, (2012)
[24]  
Stevens B., Lewis F.L., Aircraft Control and Simulation, (2003)
[25]  
Nevistic V., Primbs J.A., Constrained Nonlinear Optimal Control: A Converse HJB Approach, (1996)