A Deep Reinforcement Learning Approach for Path Following on a Quadrotor

被引:12
|
作者
Rubi, Bartomeu [1 ]
Morcego, Bernardo [1 ]
Perez, Ramon [1 ]
机构
[1] Univ Politecn Catalunya UPC, Specif Ctr Res CS2AC, Rbla St Nebridi 22, Terrassa, Spain
关键词
D O I
10.23919/ecc51009.2020.9143591
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes the Deep Deterministic Policy Grandient (DDPG) reinforcement learning algorithm to solve the path following problem in a quadrotor vehicle. This agent is implemented using a separated control and guidance structure with an autopilot tracking the attitude and velocity commands. The DDPG agent is implemented in python and it is trained and tested in the RotorS-Gazebo environment, a realistic multirotor simulator integrated in ROS. Performance is compared with Adaptive NLGL, a geometric algorithm that implements an equivalent control structure. Results show how the DDPG agent is able to outperform the Adaptive NLGL approach while reducing its complexity.
引用
收藏
页码:1092 / 1098
页数:7
相关论文
共 50 条
  • [1] Deep reinforcement learning for quadrotor path following with adaptive velocity
    Rubi, Bartomeu
    Morcego, Bernardo
    Perez, Ramon
    AUTONOMOUS ROBOTS, 2021, 45 (01) : 119 - 134
  • [2] Deep reinforcement learning for quadrotor path following with adaptive velocity
    Bartomeu Rubí
    Bernardo Morcego
    Ramon Pérez
    Autonomous Robots, 2021, 45 : 119 - 134
  • [3] Quadrotor Path Following and Reactive Obstacle Avoidance with Deep Reinforcement Learning
    Rubi, Bartomeu
    Morcego, Bernardo
    Perez, Ramon
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 103 (04)
  • [4] Quadrotor Path Following and Reactive Obstacle Avoidance with Deep Reinforcement Learning
    Bartomeu Rubí
    Bernardo Morcego
    Ramon Pérez
    Journal of Intelligent & Robotic Systems, 2021, 103
  • [5] Path Following Control for UAV Using Deep Reinforcement Learning Approach
    Yintao Zhang
    Youmin Zhang
    Ziquan Yu
    Guidance,Navigation and Control, 2021, (01) : 95 - 112
  • [6] Path Following with Supervised Deep Reinforcement Learning
    Gu, Wen-Yi
    Xu, Xin
    Yang, Jian
    PROCEEDINGS 2017 4TH IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR), 2017, : 448 - 452
  • [7] Path Following with Deep Reinforcement Learning for Autonomous Cars
    Alomari, Khaled
    Mendoza, Ricardo Carrillo
    Goehring, Daniel
    Rojas, Raul
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON ROBOTICS, COMPUTER VISION AND INTELLIGENT SYSTEMS (ROBOVIS), 2021, : 173 - 181
  • [8] Autonomous Quadrotor Path Planning Through Deep Reinforcement Learning With Monocular Depth Estimation
    Khojasteh, Mahdi Shahbazi
    Salimi-Badr, Armin
    IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2025, 6 : 34 - 51
  • [9] Path-Following Navigation in Crowds With Deep Reinforcement Learning
    Fu, Hao
    Wang, Qiang
    He, Haodong
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (11): : 20236 - 20245
  • [10] Deep Reinforcement Learning for Concentric Tube Robot Path Following
    Iyengar, Keshav
    Spurgeon, Sarah
    Stoyanov, Danail
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2024, 6 (01): : 18 - 29