Autonomous multi-drone racing method based on deep reinforcement learning

被引:0
|
作者
Kang, Yu [1 ,2 ,3 ]
Di, Jian [2 ]
Li, Ming [1 ]
Zhao, Yunbo [1 ]
Wang, Yuhui [4 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Inst Adv Technol, Hefei 230088, Peoples R China
[3] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei 230088, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
racing drone; autonomous multi-drone racing; sim-to-real; deep reinforcement learning; Markov game;
D O I
10.1007/s11432-023-4029-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Racing drones have attracted increasing attention due to their remarkable high speed and excellent maneuverability. However, autonomous multi-drone racing is quite difficult since it requires quick and agile flight in intricate surroundings and rich drone interaction. To address these issues, we propose a novel autonomous multi-drone racing method based on deep reinforcement learning. A new set of reward functions is proposed to make racing drones learn the racing skills of human experts. Unlike previous methods that required global information about tracks and track boundary constraints, the proposed method requires only limited localized track information within the range of its own onboard sensors. Further, the dynamic response characteristics of racing drones are incorporated into the training environment, so that the proposed method is more in line with the requirements of real drone racing scenarios. In addition, our method has a low computational cost and can meet the requirements of real-time racing. Finally, the effectiveness and superiority of the proposed method are verified by extensive comparison with the state-of-the-art methods in a series of simulations and real-world experiments.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Learning-based Multi-Drone Network Edge Orchestration for Video Analytics
    Qu, Chengyi
    Singh, Rounak
    Esquivel-Morel, Alicia
    Calyam, Prasad
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2022), 2022, : 1219 - 1228
  • [22] Autonomous flying of drone based on ppo reinforcement learning algorithm
    Park S.G.
    Kim D.H.
    Kim, Dong Hwan (dhkim@seoultech.ac.kr), 1600, Institute of Control, Robotics and Systems (26): : 955 - 963
  • [23] Learning-in-Games Approach for the Mission Planning of Autonomous Multi-Drone Spatio-Temporal Sensing
    Castrillo, Vittorio U.
    Pascarella, Domenico
    Pigliasco, Gianpaolo
    Iudice, Ivan
    Vozella, Angela
    IEEE ACCESS, 2024, 12 : 77586 - 77604
  • [24] HJB-RL:Initializing Reinforcement Learning with Optimal Control Policies Applied to Autonomous Drone Racing
    Nagami, Keiko
    Schwager, Mac
    ROBOTICS: SCIENCE AND SYSTEM XVII, 2021,
  • [25] Image-based Regularization for Action Smoothness in Autonomous Miniature Racing Car with Deep Reinforcement Learning
    Cao, Hoang-Giang
    Lee, I.
    Hsu, Bo-Jiun
    Lee, Zheng-Yi
    Shih, Yu-Wei
    Wang, Hsueh-Cheng
    Wu, I-Chen
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5179 - 5186
  • [26] Wireless sensing charging based on multi-drone cooperation
    Xu, Guoxin
    Zhao, Jiawen
    Wang, Xuehe
    IET NETWORKS, 2024, 13 (03) : 199 - 207
  • [27] Multi-Objective Reinforcement Learning for Autonomous Drone Navigation in Urban Area
    Wu, Jiahao
    Ye, Yang
    Du, Jing
    CONSTRUCTION RESEARCH CONGRESS 2024: ADVANCED TECHNOLOGIES, AUTOMATION, AND COMPUTER APPLICATIONS IN CONSTRUCTION, 2024, : 707 - 716
  • [28] Deep Reinforcement Learning for Drone Delivery
    Munoz, Guillem
    Barrado, Cristina
    Cetin, Ender
    Salami, Esther
    DRONES, 2019, 3 (03) : 1 - 19
  • [29] Drone Deep Reinforcement Learning: A Review
    Azar, Ahmad Taher
    Koubaa, Anis
    Ali Mohamed, Nada
    Ibrahim, Habiba A.
    Ibrahim, Zahra Fathy
    Kazim, Muhammad
    Ammar, Adel
    Benjdira, Bilel
    Khamis, Alaa M.
    Hameed, Ibrahim A.
    Casalino, Gabriella
    ELECTRONICS, 2021, 10 (09)
  • [30] Multi-Drone 3D Building Reconstruction Method
    Filatov, Anton
    Zaslavskiy, Mark
    Krinkin, Kirill
    MATHEMATICS, 2021, 9 (23)