Autonomous multi-drone racing method based on deep reinforcement learning

被引:0
|
作者
Kang, Yu [1 ,2 ,3 ]
Di, Jian [2 ]
Li, Ming [1 ]
Zhao, Yunbo [1 ]
Wang, Yuhui [4 ]
机构
[1] Univ Sci & Technol China, Dept Automat, Hefei 230026, Peoples R China
[2] Univ Sci & Technol China, Inst Adv Technol, Hefei 230088, Peoples R China
[3] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei 230088, Peoples R China
[4] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 210016, Peoples R China
基金
中国国家自然科学基金;
关键词
racing drone; autonomous multi-drone racing; sim-to-real; deep reinforcement learning; Markov game;
D O I
10.1007/s11432-023-4029-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Racing drones have attracted increasing attention due to their remarkable high speed and excellent maneuverability. However, autonomous multi-drone racing is quite difficult since it requires quick and agile flight in intricate surroundings and rich drone interaction. To address these issues, we propose a novel autonomous multi-drone racing method based on deep reinforcement learning. A new set of reward functions is proposed to make racing drones learn the racing skills of human experts. Unlike previous methods that required global information about tracks and track boundary constraints, the proposed method requires only limited localized track information within the range of its own onboard sensors. Further, the dynamic response characteristics of racing drones are incorporated into the training environment, so that the proposed method is more in line with the requirements of real drone racing scenarios. In addition, our method has a low computational cost and can meet the requirements of real-time racing. Finally, the effectiveness and superiority of the proposed method are verified by extensive comparison with the state-of-the-art methods in a series of simulations and real-world experiments.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Autonomous multi-drone racing method based on deep reinforcement learning
    Yu KANG
    Jian DI
    Ming LI
    Yunbo ZHAO
    Yuhui WANG
    ScienceChina(InformationSciences), 2024, 67 (08) : 35 - 48
  • [2] Autonomous Drone Racing with Deep Reinforcement Learning
    Song, Yunlong
    Steinweg, Mats
    Kaufmann, Elia
    Scaramuzza, Davide
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 1205 - 1212
  • [3] Autonomous drone interception with Deep Reinforcement Learning
    Bertoin, David
    Gauffriau, Adrien
    Grasset, Damien
    Gupta, Jayant Sen
    CEUR Workshop Proceedings, 2022, 3173
  • [4] Learning Deep Sensorimotor Policies for Vision-based Autonomous Drone Racing
    Fu, Jiawei
    Song, Yunlong
    Wu, Yan
    Yu, Fisher
    Scaramuzza, Davide
    2023 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2023, : 5243 - 5250
  • [5] Multi-Drone Collaborative Shepherding Through Multi-Task Reinforcement Learning
    Wang, Guanghui
    Peng, Junkun
    Guan, Chenyang
    Chen, Jinhua
    Guo, Bing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 10311 - 10318
  • [6] Multi-drone Control with Autonomous Mission Support
    Paula, Nuno
    Areias, Bruno
    Reis, Andre Braga
    Sargento, Susana
    2019 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS (PERCOM WORKSHOPS), 2019, : 918 - 923
  • [7] Comparing deep reinforcement learning architectures for autonomous racing
    Evans, Benjamin David
    Jordaan, Hendrik Willem
    Engelbrecht, Herman Arnold
    MACHINE LEARNING WITH APPLICATIONS, 2023, 14
  • [8] Auction-Based Charging Scheduling With Deep Learning Framework for Multi-Drone Networks
    Shin, MyungJae
    Kim, Joongheon
    Levorato, Marco
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (05) : 4235 - 4248
  • [9] Learning fast in autonomous drone racing
    De Wagter, C.
    Paredes-Valles, F.
    Sheth, N.
    de Croon, G.
    NATURE MACHINE INTELLIGENCE, 2021, 3 (10) : 923 - 923
  • [10] Learning fast in autonomous drone racing
    C. De Wagter
    F. Paredes-Vallés
    N. Sheth
    G. de Croon
    Nature Machine Intelligence, 2021, 3 : 923 - 923