Learning-based adaptive optimal output regulation of linear and nonlinear systems: an overview

被引:17
作者
Gao, Weinan [1 ]
Jiang, Zhong-Ping [2 ]
机构
[1] Florida Inst Technol, Coll Engn & Sci, Dept Mech & Civil Engn, 150 W Univ Blvd, Melbourne, FL 32901 USA
[2] NYU, Tandon Sch Engn, Dept Elect & Comp Engn, 6 MetroTech Ctr, Brooklyn, NY 11201 USA
基金
美国国家科学基金会;
关键词
Adaptive optimal output regulation; Adaptive dynamic programming; Reinforcement learning; Learning-based control; INTERNAL-MODEL PRINCIPLE; MULTIAGENT SYSTEMS; NEURAL-NETWORKS; VALUE-ITERATION; CRUISE CONTROL; STABILITY; CONTROLLERS; TRACKING; GAME; GO;
D O I
10.1007/s11768-022-00081-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper reviews recent developments in learning-based adaptive optimal output regulation that aims to solve the problem of adaptive and optimal asymptotic tracking with disturbance rejection. The proposed framework aims to bring together two separate topics-output regulation and adaptive dynamic programming-that have been under extensive investigation due to their broad applications in modern control engineering. Under this framework, one can solve optimal output regulation problems of linear, partially linear, nonlinear, and multi-agent systems in a data-driven manner. We will also review some practical applications based on this framework, such as semi-autonomous vehicles, connected and autonomous vehicles, and nonlinear oscillators.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 95 条
[51]  
Krstic M., 1995, Nonlinear and Adaptive Control Design
[52]   Neural-network-based approximate output regulation of discrete-time nonlinear systems [J].
Lan, Weiyao ;
Huang, Jie .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2007, 18 (04) :1196-1208
[53]  
Lei Z., 2021, IEEE Transactions on Neural Networks and Learning Systems
[54]  
Lewis F. L., 2012, Optimal Control
[55]   Distributed adaptive controllers for cooperative output regulation of heterogeneous agents over directed graphs [J].
Li, Zhongkui ;
Chen, Michael Z. Q. ;
Ding, Zhengtao .
AUTOMATICA, 2016, 68 :179-183
[56]   Adaptive Dynamic Programming for Control: A Survey and Recent Advances [J].
Liu, Derong ;
Xue, Shan ;
Zhao, Bo ;
Luo, Biao ;
Wei, Qinglai .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2021, 51 (01) :142-160
[57]  
Liu YY, 2018, 2018 9TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), P38, DOI 10.1109/UEMCON.2018.8796611
[58]   Distributed Feedforward Approach to Cooperative Output Regulation Subject to Communication Delays and Switching Networks [J].
Lu, Maobin ;
Liu, Lu .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (04) :1999-2005
[59]  
MacColl L.R. A., 1945, Fundamental Theory of Servomechanisms
[60]   Uniform practical nonlinear output regulation [J].
Marconi, Lorenzo ;
Praly, Laurent .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2008, 53 (05) :1184-1202