A Review of Unmanned Vehicle Control with Adaptive Dynamic Programming Implementations

被引:1
作者
Liu, Hao [1 ,2 ]
Yi, Xinning [1 ]
Liu, Deyuan [3 ]
Valavanis, Kimon P. [4 ]
机构
[1] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[2] Zhongguancun Lab, Beijing 100094, Peoples R China
[3] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[4] Univ Denver, Dept Elect & Comp Engn, Denver, CO 80208 USA
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Unmanned vehicles; Adaptive dynamic programming; Optimal control; Robust control; Event-triggered mechanism; OPTIMAL TRACKING CONTROL; TIME NONLINEAR-SYSTEMS; ROBUST-CONTROL; MOTION CONTROL; TRAJECTORY-TRACKING; ALGORITHM; DESIGN; MODEL; ARCHITECTURE; QUADROTORS;
D O I
10.1007/s10846-024-02207-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this review, the optimal control designs via adaptive dynamic programming (ADP) of unmanned vehicles are investigated. Various complex tasks in unmanned systems are addressed as fundamental optimal regulation and tracking control problems related to the position and attitude of vehicles. The optimal control can be obtained by solving the Hamilton-Jacobi-Bellman equation using ADP-based control methods. Neural network implementations and policy iterative ADP algorithms are common approaches in ADP-based control methods, enabling online updates and partially model-free control for unmanned vehicles with various structures. For complexities and uncertain disturbances in unmanned vehicle dynamics, robust ADP-based control methods are proposed, including robust ADP control for matched and unmatched uncertainties, robust guaranteed cost control with ADP, and ADP-based H infinity\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$H_\infty $$\end{document} control. In order to reduce communication and computational costs in unmanned vehicle operations, a preliminary discussion on event-triggered optimal control using ADP-based control methods is presented.
引用
收藏
页数:16
相关论文
共 92 条
[1]   Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach [J].
Abu-Khalaf, M ;
Lewis, FL .
AUTOMATICA, 2005, 41 (05) :779-791
[2]   Hover control of an UAV with backstepping design including input saturations [J].
Azinheira, Jose Raul ;
Moutinho, Alexandra .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2008, 16 (03) :517-526
[3]   A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems [J].
Bhasin, S. ;
Kamalapurkar, R. ;
Johnson, M. ;
Vamvoudakis, K. G. ;
Lewis, F. L. ;
Dixon, W. E. .
AUTOMATICA, 2013, 49 (01) :82-92
[4]   Nonlinear trajectory-tracking control for autonomous underwater vehicle based on iterative adaptive dynamic programming [J].
Che, Gaofeng ;
Liu, Lijun ;
Yu, Zhen .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 37 (03) :4205-4215
[5]   From Unmanned Systems to Autonomous Intelligent Systems [J].
Chen, Jie ;
Sun, Jian ;
Wang, Gang .
ENGINEERING, 2022, 12 :16-19
[6]   Adaptive Optimal Tracking Control of an Underactuated Surface Vessel Using Actor-Critic Reinforcement Learning [J].
Chen, Lin ;
Dai, Shi-Lu ;
Dong, Chao .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) :7520-7533
[7]   Adaptive Energy-Efficient Control Allocation for Planar Motion Control of Over-Actuated Electric Ground Vehicles [J].
Chen, Yan ;
Wang, Junmin .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2014, 22 (04) :1362-1373
[8]   Finite-Horizon LQR Control of Quadrotors on SE2(3) [J].
Cohen, Mitchell R. ;
Abdulrahim, Khairi ;
Forbes, James Richard .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) :5748-5755
[9]   An approximate dynamic programming approach for solving an air combat maneuvering problem [J].
Crumpacker, James B. ;
Robbins, Matthew J. ;
Jenkins, Phillip R. .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
[10]   Learning-Based Balance Control of Wheel-Legged Robots [J].
Cui, Leilei ;
Wang, Shuai ;
Zhang, Jingfan ;
Zhang, Dongsheng ;
Lai, Jie ;
Zheng, Yu ;
Zhang, Zhengyou ;
Jiang, Zhong-Ping .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :7667-7674