Heterogeneous formation control of multiple rotorcrafts with unknown dynamics by reinforcement learning

被引：28

作者：

Liu, Hao ^{[1
,2
]}

Peng, Fachun ^{[1
,2
]}

Modares, Hamidreza ^{[3
]}

Kiumarsi, Bahare ^{[4
]}

机构：

[1] Beihang Univ, Sch Astronaut, Beijing 100191, Peoples R China

[2] Beihang Univ, Minist Educ, Key Lab Spacecraft Design Optimizat & Dynam Simul, Beijing 100191, Peoples R China

[3] Michigan State Univ, Dept Mech Engn, E Lansing, MI 48824 USA

[4] Michigan State Univ, Dept Elect & Comp Engn, E Lansing, MI 48824 USA

来源：

INFORMATION SCIENCES | 2021年 / 558卷

基金：

中国国家自然科学基金;

关键词：

Formation control; Multi-agent systems; Heterogeneous systems; Reinforcement learning; Rotorcrafts;

D O I：

10.1016/j.ins.2021.01.011

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper, a distributed model-free solution based on reinforcement learning is proposed for the leader-follower formation control problem of heterogeneous multi-agent systems. The multi-agent system consists of multiple rotorcrafts involving a virtual leader and multiple followers, where the dynamics of leaders and followers is unknown. The formation control problem is firstly formulated as an optimal output regulation problem. A discounted performance function is then introduced to guarantee that the tracking error asymptotically converges to zero, and an online off-policy reinforcement learning algorithm is proposed to solve the optimal output problem online using the data generated along the trajectories of the agents. A simulation example is provided to validate the effectiveness of the proposed control method. (C) 2021 Elsevier Inc. All rights reserved.

引用

页码：194 / 207

页数：14

共 50 条

[1] Heterogeneous Formation Control of Multiple Rotorcrafts with Unknown Dynamics using Reinforcement Learning
Liu, Hao
Peng, Fachun
Modares, Hamidreza
Kiumarsi, Bahare
Lewis, Frank L.
2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 3617 - 3622
[2] Heterogeneous formation control of multiple UAVs with limited-input leader via reinforcement learning
Liu, Hao
Meng, Qingyao
Peng, Fachun
Lewis, Frank L.
NEUROCOMPUTING, 2020, 412 (412) : 63 - 71
[3] Heterogeneous optimal formation control of nonlinear multi-agent systems with unknown dynamics by safe reinforcement learning
Golmisheh, Fatemeh Mahdavi
Shamaghdari, Saeed
APPLIED MATHEMATICS AND COMPUTATION, 2024, 460
[4] Optimized Formation Control Using Simplified Reinforcement Learning for a Class of Multiagent Systems With Unknown Dynamics
Wen, Guoxing
Chen, C. L. Philip
Li, Bin
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (09) : 7879 - 7888
[5] Fault-Tolerant Control for the Formation of Multiple Unknown Nonlinear Quadrotors via Reinforcement Learning
Zhao, Wanbing
Liu, Hao
Lewis, Frank L.
IFAC PAPERSONLINE, 2020, 53 (02): : 2465 - 2470
[6] Fault-Tolerant Formation Control for Heterogeneous Vehicles Via Reinforcement Learning
Zhao, Wanbing
Liu, Hao
Valavanis, Kimon P.
Lewis, Frank L.
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2022, 58 (04) : 2796 - 2806
[7] Distributed Tracking Control of Completely Unknown Heterogeneous MASs Based on Reinforcement Learning
Wang, Zhipeng
Huo, Shicheng
2024 14TH ASIAN CONTROL CONFERENCE, ASCC 2024, 2024, : 587 - 592
[8] Containment Control of Heterogeneous Systems with Active Leaders of Bounded Unknown Control using Reinforcement Learning
Yang, Yongliang
Song, Ruizhuo
Yin, Yixin
Wunsch, Donald C., II
Modares, Hamidreza
2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017,
[9] Robust Optimal Formation Control of Heterogeneous Multi-Agent System via Reinforcement Learning
Lin, Wei
Zhao, Wanbing
Liu, Hao
IEEE ACCESS, 2020, 8 (08): : 218424 - 218432
[10] Formation Learning Control of Multiple Autonomous Underwater Vehicles With Heterogeneous Nonlinear Uncertain Dynamics
Yuan, Chengzhi
Licht, Stephen
He, Haibo
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (10) : 2920 - 2934

← 1 2 3 4 5 →