Optimal Containment Control of a Quadrotor Team With Active Leaders via Reinforcement Learning

被引:3
|
作者
Cheng, Ming [1 ]
Liu, Hao [2 ,3 ]
Gao, Qing [3 ,4 ]
Lu, Jinhu [3 ,4 ]
Xia, Xiaohua [5 ]
机构
[1] Beihang Univ, Sch Astronaut, Beijing 100191, Peoples R China
[2] Beihang Univ, Inst Artificial Intelligence, Beijing 100191, Peoples R China
[3] Zhongguancun Lab, Beijing 100191, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[5] Univ Pretoria, Dept Elect Elect & Comp Engn, ZA-0002 Pretoria, South Africa
基金
美国国家科学基金会; 中国国家自然科学基金; 北京市自然科学基金;
关键词
Cooperative control; multiagent system; optimal control; quadrotor; reinforcement learning (RL); MULTIAGENT SYSTEMS; TRACKING CONTROL;
D O I
10.1109/TCYB.2023.3284648
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article proposes an optimal controller for a team of underactuated quadrotors with multiple active leaders in containment control tasks. The quadrotor dynamics are underactuated, nonlinear, uncertain, and subject to external disturbances. The active team leaders have control inputs to enhance the maneuverability of the containment system. The proposed controller consists of a position control law to guarantee the achievement of position containment and an attitude control law to regulate the rotational motion, which are learned via off-policy reinforcement learning using historical data from quadrotor trajectories. The closed-loop system stability can be guaranteed by theoretical analysis. Simulation results of cooperative transportation missions with multiple active leaders demonstrate the effectiveness of the proposed controller.
引用
收藏
页码:4502 / 4512
页数:11
相关论文
共 50 条
  • [21] Adaptive Trajectory Tracking Control using Reinforcement Learning for Quadrotor
    Lou, Wenjie
    Guo, Xiao
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2016, 13
  • [22] Data-Driven Reinforcement Learning Control for Quadrotor Systems
    Dang, Ngoc Trung
    Dao, Phuong Nam
    INTERNATIONAL JOURNAL OF MECHANICAL ENGINEERING AND ROBOTICS RESEARCH, 2024, 13 (05): : 495 - 501
  • [23] Fixed-Time Fault-Tolerant Optimal Attitude Control of Spacecraft With Performance Constraint via Reinforcement Learning
    Xiao, Bing
    Zhang, Haichao
    Chen, Zhaoyue
    Cao, Lu
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (06) : 7715 - 7724
  • [24] Modular Reinforcement Learning for a Quadrotor UAV With Decoupled Yaw Control
    Yu, Beomyeol
    Lee, Taeyoung
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (01): : 572 - 579
  • [25] Quadrotor Control using Reinforcement Learning under Wind Disturbance
    Lu, Songshuo
    Li, Yanjie
    Liu, Zihan
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 3233 - 3240
  • [26] Robust Quadrotor Control through Reinforcement Learning with Disturbance Compensation
    Pi, Chen-Huan
    Ye, Wei-Yuan
    Cheng, Stone
    APPLIED SCIENCES-BASEL, 2021, 11 (07):
  • [27] Performance-guaranteed containment control for pure-feedback multi agent systems via reinforcement learning algorithm
    Luo, Ao
    Xiao, Wenbin
    Li, Xiao-Meng
    Yao, Deyin
    Zhou, Qi
    INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2022, 32 (18) : 10180 - 10200
  • [28] Robust Optimal Formation Control of Heterogeneous Multi-Agent System via Reinforcement Learning
    Lin, Wei
    Zhao, Wanbing
    Liu, Hao
    IEEE ACCESS, 2020, 8 (08): : 218424 - 218432
  • [29] Robust Near-optimal Control for Constrained Nonlinear System via Integral Reinforcement Learning
    Qiu, Yu-Qing
    Li, Yan
    Wang, Zhong
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2023, 21 (04) : 1319 - 1330
  • [30] How to Train Your Quadrotor: A Framework for Consistently Smooth and Responsive Flight Control via Reinforcement Learning
    Mysore, Siddharth
    Mabsout, Bassel
    Saenko, Kate
    Mancuso, Renato
    ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2021, 5 (04)