Optimal Containment Control of a Quadrotor Team With Active Leaders via Reinforcement Learning

被引:3
|
作者
Cheng, Ming [1 ]
Liu, Hao [2 ,3 ]
Gao, Qing [3 ,4 ]
Lu, Jinhu [3 ,4 ]
Xia, Xiaohua [5 ]
机构
[1] Beihang Univ, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[3] Zhongguancun Lab, Beijing 100191, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[5] Univ Pretoria, Dept Elect Elect & Comp Engn, ZA-0002 Pretoria, South Africa
基金
美国国家科学基金会; 中国国家自然科学基金; 北京市自然科学基金;
关键词
Cooperative control; multiagent system; optimal control; quadrotor; reinforcement learning (RL); MULTIAGENT SYSTEMS; TRACKING CONTROL;
D O I
10.1109/TCYB.2023.3284648
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes an optimal controller for a team of underactuated quadrotors with multiple active leaders in containment control tasks. The quadrotor dynamics are underactuated, nonlinear, uncertain, and subject to external disturbances. The active team leaders have control inputs to enhance the maneuverability of the containment system. The proposed controller consists of a position control law to guarantee the achievement of position containment and an attitude control law to regulate the rotational motion, which are learned via off-policy reinforcement learning using historical data from quadrotor trajectories. The closed-loop system stability can be guaranteed by theoretical analysis. Simulation results of cooperative transportation missions with multiple active leaders demonstrate the effectiveness of the proposed controller.
引用
收藏
页码:4502 / 4512
页数:11
相关论文
共 50 条
  • [31] Optimal Incremental-containment Control of Two-order Swarm System Based on Reinforcement Learning
    Chen, Haipeng
    Fu, Wenxing
    Liu, Junmin
    Yu, Dengxiu
    Chen, Kang
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2023, 21 (10) : 3443 - 3455
  • [32] Integral Reinforcement-Learning-Based Optimal Containment Control for Partially Unknown Nonlinear Multiagent Systems
    Wu, Qiuye
    Wu, Yongheng
    Wang, Yonghua
    ENTROPY, 2023, 25 (02)
  • [33] Event-Based Optimal Containment Control for Constrained Multiagent Systems Using Integral Reinforcement Learning
    Guo, Zijie
    Ren, Hongru
    Li, Hongyi
    Huang, Tingwen
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2025, 12 (01): : 609 - 619
  • [34] Autonomous Landing of the Quadrotor on the Mobile Platform via Meta Reinforcement Learning
    Cao, Qianqian
    Liu, Ziyi
    Yu, Hai
    Liang, Xiao
    Fang, Yongchun
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 2269 - 2280
  • [35] Autonomous Landing of the Quadrotor on the Mobile Platform via Meta Reinforcement Learning
    Cao, Qianqian
    Liu, Ziyi
    Yu, Hai
    Liang, Xiao
    Fang, Yongchun
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 2269 - 2280
  • [36] Reinforcement Learning Informed by Optimal Control
    Onnheim, Magnus
    Andersson, Pontus
    Gustavsson, Emil
    Jirstrand, Mats
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: WORKSHOP AND SPECIAL SESSIONS, 2019, 11731 : 403 - 407
  • [37] Optimal Greedy Control in Reinforcement Learning
    Gorobtsov, Alexander
    Sychev, Oleg
    Orlova, Yulia
    Smirnov, Evgeniy
    Grigoreva, Olga
    Bochkin, Alexander
    Andreeva, Marina
    SENSORS, 2022, 22 (22)
  • [38] Fractional-Order Systems Optimal Control via Actor-Critic Reinforcement Learning and Its Validation for Chaotic MFET
    Li, Dongdong
    Dong, Jiuxiang
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2024, : 1173 - 1182
  • [39] Inverse Reinforcement Learning in Tracking Control Based on Inverse Optimal Control
    Xue, Wenqian
    Kolaric, Patrik
    Fan, Jialu
    Lian, Bosen
    Chai, Tianyou
    Lewis, Frank L.
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) : 10570 - 10581
  • [40] Adaptive Neural Network Optimal Backstepping Control of Strict Feedback Nonlinear Systems via Reinforcement Learning
    Zhong, Mei
    Cao, Jinde
    Liu, Heng
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 832 - 847