Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems

被引:252
作者
机构
[1] Center for Control, Dynamicalsystems and Computation (CCDC), University of California, Santa Barbara, 93106-9560, CA
来源
Vamvoudakis, Kyriakos G. (kyriakos@ece.ucsb.edu) | 1600年 / Institute of Electrical and Electronics Engineers Inc.卷 / 01期
关键词
adaptive control; Event-triggered; optimal control; reinforcement learning;
D O I
10.1109/JAS.2014.7004686
中图分类号
学科分类号
摘要
This paper proposes a novel optimal adaptive event-triggered control algorithm for nonlinear continuous-time systems. The goal is to reduce the controller updates, by sampling the state only when an event is triggered to maintain stability and optimality. The online algorithm is implemented based on an actor/critic neural network structure. A critic neural network is used to approximate the cost and an actor neural network is used to approximate the optimal event-triggered controller. Since in the algorithm proposed there are dynamics that exhibit continuous evolutions described by ordinary differential equations and instantaneous jumps or impulses, we will use an impulsive system approach. A Lyapunov stability proof ensures that the closed-loop system is asymptotically stable. Finally, we illustrate the effectiveness of the proposed solution compared to a time-triggered controller. © 2014 IEEE.
引用
收藏
页码:282 / 293
页数:11
相关论文
共 25 条
[1]  
Heemels W.P.M.H., Donkers M.C.F., Teel A.R., Periodic event-triggered control for linear systems, IEEE Transactions on Automatic Control, 58, 4, pp. 847-861, (2013)
[2]  
Lemmon M.D., Event-triggered feedback in control, estimation, and optimization, Networked Control Systems, 405, pp. 293-358, (2010)
[3]  
Tabuada P., Event-triggered real-time scheduling of stabilizing control tasks, IEEE Transactions on Automatic Control, 52, 9, pp. 1680-1685, (2007)
[4]  
Lewis F.L., Vrabie D., Vamvoudakis K.G., Reinforcement learning and feedback control: Using natural decision methods to design optimal adaptive controllers, IEEE Control Systems, 32, 6, pp. 76-105, (2012)
[5]  
Haddad W.M., Chellaboina V., Nersesov S.G., Impulsive Hybrid Dynamical Systems: Stability Dissipativity and Control, (2006)
[6]  
Hespanha J.P., Liberzon D., Teel A.R., Lyapunov conditions for inputto- state stability of impulsive systems, Automatica, 44, 11, pp. 2735-2744, (2008)
[7]  
Naghshtabrizi P., Hespanha J.P., Teel A.R., Exponential stability of impulsive systems with application to uncertain sampled-data systems, Systems and Control Letters, 57, 5, pp. 378-385, (2008)
[8]  
Donkers M.C.F., Heemels W.P.M.H., Output-based event-triggered control with guaranteed L8-gain and improved and decentralised event-triggering, IEEE Transactions on Automatic Control, 57, 6, pp. 1362-1376, (2012)
[9]  
Wang X., Lemmon M.D., On event design in event-triggered feedback systems, Automatica, 47, 10, pp. 2319-2322, (2012)
[10]  
Demir O., Lunze J., Cooperative control of multi-agent systems with event-based communication, Proceedings of the 2012 American Control Conference, pp. 4504-4509, (2012)