Optimal Containment Control of a Quadrotor Team With Active Leaders via Reinforcement Learning

被引:3
|
作者
Cheng, Ming [1 ]
Liu, Hao [2 ,3 ]
Gao, Qing [3 ,4 ]
Lu, Jinhu [3 ,4 ]
Xia, Xiaohua [5 ]
机构
[1] Beihang Univ, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[3] Zhongguancun Lab, Beijing 100191, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[5] Univ Pretoria, Dept Elect Elect & Comp Engn, ZA-0002 Pretoria, South Africa
基金
美国国家科学基金会; 中国国家自然科学基金; 北京市自然科学基金;
关键词
Cooperative control; multiagent system; optimal control; quadrotor; reinforcement learning (RL); MULTIAGENT SYSTEMS; TRACKING CONTROL;
D O I
10.1109/TCYB.2023.3284648
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes an optimal controller for a team of underactuated quadrotors with multiple active leaders in containment control tasks. The quadrotor dynamics are underactuated, nonlinear, uncertain, and subject to external disturbances. The active team leaders have control inputs to enhance the maneuverability of the containment system. The proposed controller consists of a position control law to guarantee the achievement of position containment and an attitude control law to regulate the rotational motion, which are learned via off-policy reinforcement learning using historical data from quadrotor trajectories. The closed-loop system stability can be guaranteed by theoretical analysis. Simulation results of cooperative transportation missions with multiple active leaders demonstrate the effectiveness of the proposed controller.
引用
收藏
页码:4502 / 4512
页数:11
相关论文
共 50 条
  • [1] Optimal Containment Control of Multiple Quadrotors via Reinforcement Learning
    Cheng, Ming
    Liu, Hao
    Liu, Deyuan
    Gu, Haibo
    Wang, Xiangke
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 2632 - 2637
  • [2] Optimal Containment Control for Unknown Active Heterogeneous MASs via Model-Free Recursive Reinforcement Learning
    Xia, Lina
    Li, Qing
    Song, Ruizhuo
    Yang, Gaofu
    IEEE ACCESS, 2025, 13 : 7603 - 7613
  • [3] Optimal Containment Control of Unknown Heterogeneous Systems With Active Leaders
    Yang, Yongliang
    Modares, Hamidreza
    Wunsch, Donald C., II
    Yin, Yixin
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2019, 27 (03) : 1228 - 1236
  • [4] Containment Control of Heterogeneous Systems with Active Leaders of Bounded Unknown Control using Reinforcement Learning
    Yang, Yongliang
    Song, Ruizhuo
    Yin, Yixin
    Wunsch, Donald C., II
    Modares, Hamidreza
    2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017,
  • [5] Output Resilient Containment Control of Heterogeneous Systems With Active Leaders Using Reinforcement Learning Under Attack Inputs
    Li, Qing
    Xia, Lina
    Song, Ruizhuo
    IEEE ACCESS, 2019, 7 : 162219 - 162228
  • [6] Data-Driven Optimal Formation Control for Quadrotor Team With Unknown Dynamics
    Zhao, Wanbing
    Liu, Hao
    Lewis, Frank L.
    Wang, Xinlong
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (08) : 7889 - 7898
  • [7] Reinforcement Learning-Based Finite-Time Optimal Containment Control for Underactuated Surface Vehicles With Guaranteed Performance
    Chen, Lin
    Dong, Chao
    Dai, Shi-Lu
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (12): : 7206 - 7217
  • [8] Safety-Critical Containment Control for Quadrotor Team Using Exponential Control Barrier Functions
    Xia, Zheng
    Chen, Mou
    UNMANNED SYSTEMS, 2024,
  • [9] Adaptive Prescribed-Time Optimal Control for Flexible-Joint Robots via Reinforcement Learning
    Xie, Shiyu
    Sun, Wei
    Sun, Yougang
    Su, Shun-Feng
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025,
  • [10] Optimal Control via Reinforcement Learning with Symbolic Policy Approximation
    Kubalik, Jiri
    Alibekov, Eduard
    Babuska, Robert
    IFAC PAPERSONLINE, 2017, 50 (01): : 4162 - 4167