Learning-based adaptive optimal output regulation of linear and nonlinear systems: an overview

被引:17
作者
Gao, Weinan [1 ]
Jiang, Zhong-Ping [2 ]
机构
[1] Florida Inst Technol, Coll Engn & Sci, Dept Mech & Civil Engn, 150 W Univ Blvd, Melbourne, FL 32901 USA
[2] NYU, Tandon Sch Engn, Dept Elect & Comp Engn, 6 MetroTech Ctr, Brooklyn, NY 11201 USA
基金
美国国家科学基金会;
关键词
Adaptive optimal output regulation; Adaptive dynamic programming; Reinforcement learning; Learning-based control; INTERNAL-MODEL PRINCIPLE; MULTIAGENT SYSTEMS; NEURAL-NETWORKS; VALUE-ITERATION; CRUISE CONTROL; STABILITY; CONTROLLERS; TRACKING; GAME; GO;
D O I
10.1007/s11768-022-00081-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper reviews recent developments in learning-based adaptive optimal output regulation that aims to solve the problem of adaptive and optimal asymptotic tracking with disturbance rejection. The proposed framework aims to bring together two separate topics-output regulation and adaptive dynamic programming-that have been under extensive investigation due to their broad applications in modern control engineering. Under this framework, one can solve optimal output regulation problems of linear, partially linear, nonlinear, and multi-agent systems in a data-driven manner. We will also review some practical applications based on this framework, such as semi-autonomous vehicles, connected and autonomous vehicles, and nonlinear oscillators.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 95 条
[1]  
Astolfi A., 2008, Analysis and Design of Nonlinear Control Systems
[2]   Reinforcement Learning and Adaptive Optimal Control for Continuous-Time Nonlinear Systems: A Value Iteration Approach [J].
Bian, Tao ;
Jiang, Zhong-Ping .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) :2781-2790
[3]   CONTINUOUS-TIME ROBUST DYNAMIC PROGRAMMING [J].
Bian, Tao ;
Jiang, Zhong-Ping .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2019, 57 (06) :4150-4174
[4]   Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design [J].
Bian, Tao ;
Jiang, Zhong-Ping .
AUTOMATICA, 2016, 71 :348-360
[5]  
Bonivento C., 2007, ADV CONTROL THEORY A
[6]   Structurally stable output regulation of nonlinear systems [J].
Byrnes, CI ;
Priscoli, FD ;
Isidori, A ;
Kang, W .
AUTOMATICA, 1997, 33 (03) :369-385
[7]  
Carr J., 1982, APPL CTR MANIFOLD TH
[8]   Linear output regulation with dynamic optimization for uncertain linear over-actuated systems [J].
Cocetti, Matteo ;
Serrani, Andrea ;
Zaccarian, Luca .
AUTOMATICA, 2018, 97 :214-225
[9]   Asymptotic Trajectory Tracking of Autonomous Bicycles via Backstepping and Optimal Control [J].
Cui, Leilei ;
Wang, Shuai ;
Zhang, Zhengyou ;
Jiang, Zhong-Ping .
IEEE CONTROL SYSTEMS LETTERS, 2022, 6 :1292-1297
[10]   An Optimal Primary Frequency Control Based on Adaptive Dynamic Programming for Islanded Modernized Microgrids [J].
Davari, Masoud ;
Gao, Weinan ;
Jiang, Zhong-Ping ;
Lewis, Frank L. .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (03) :1109-1121