A Deep Reinforcement Learning Approach for Path Following on a Quadrotor

被引:12
|
作者
Rubi, Bartomeu [1 ]
Morcego, Bernardo [1 ]
Perez, Ramon [1 ]
机构
[1] Univ Politecn Catalunya UPC, Specif Ctr Res CS2AC, Rbla St Nebridi 22, Terrassa, Spain
关键词
D O I
10.23919/ecc51009.2020.9143591
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes the Deep Deterministic Policy Grandient (DDPG) reinforcement learning algorithm to solve the path following problem in a quadrotor vehicle. This agent is implemented using a separated control and guidance structure with an autopilot tracking the attitude and velocity commands. The DDPG agent is implemented in python and it is trained and tested in the RotorS-Gazebo environment, a realistic multirotor simulator integrated in ROS. Performance is compared with Adaptive NLGL, a geometric algorithm that implements an equivalent control structure. Results show how the DDPG agent is able to outperform the Adaptive NLGL approach while reducing its complexity.
引用
收藏
页码:1092 / 1098
页数:7
相关论文
共 50 条
  • [41] Deep learning and reinforcement learning approach on microgrid
    Chandrasekaran, Kumar
    Kandasamy, Prabaakaran
    Ramanathan, Srividhya
    INTERNATIONAL TRANSACTIONS ON ELECTRICAL ENERGY SYSTEMS, 2020, 30 (10):
  • [42] A Model-free Deep Reinforcement Learning Approach for Robotic Manipulators Path Planning
    Liu, Wenxing
    Niu, Hanlin
    Mahyuddin, Muhammad Nasiruddin
    Herrmann, Guido
    Carrasco, Joaquin
    2021 21ST INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2021), 2021, : 512 - 517
  • [43] Deep Reinforcement Learning Approach for UAV Search Path Planning In Discrete Time and Space
    Benalaya, Najoua
    Amdouni, Ichrak
    Adjih, Cedric
    Laouiti, Anis
    Saidane, Leila Azouz
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 1437 - 1442
  • [44] Rescue path planning for urban flood: A deep reinforcement learning-based approach
    Li, Xiao-Yan
    Wang, Xia
    RISK ANALYSIS, 2024,
  • [45] An Iterative Learning Controller for Quadrotor UAV Path Following at a Constant Altitude
    Ma Zhaowei
    Hu Tianjiang
    Shen Lincheng
    Kong Weiwei
    Zhao Boxin
    Yao Kaidi
    2015 34TH CHINESE CONTROL CONFERENCE (CCC), 2015, : 4406 - 4411
  • [46] Path following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach
    Cao, Yu
    Ni, Kan
    Jiang, Xiongwen
    Kuroiwa, Taiga
    Zhang, Haohao
    Kawaguchi, Takahiro
    Hashimoto, Seiji
    Jiang, Wei
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [47] USV Formation and Path-Following Control via Deep Reinforcement Learning With Random Braking
    Zhao, Yujiao
    Ma, Yong
    Hu, Songlin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (12) : 5468 - 5478
  • [48] Taming an Autonomous Surface Vehicle for Path Following and Collision Avoidance Using Deep Reinforcement Learning
    Meyer, Eivind
    Robinson, Haakon
    Rasheed, Adil
    San, Omer
    IEEE ACCESS, 2020, 8 : 41466 - 41481
  • [49] CONTROL METHOD FOR PATH FOLLOWING AND COLLISION AVOIDANCE OF AUTONOMOUS SHIP BASED ON DEEP REINFORCEMENT LEARNING
    Zhao, Luman
    Roh, Myung-Il
    Lee, Sung-Jun
    JOURNAL OF MARINE SCIENCE AND TECHNOLOGY-TAIWAN, 2019, 27 (04): : 293 - 310
  • [50] Path-following optimal control of autonomous underwater vehicle based on deep reinforcement learning
    Wang, Zhanyuan
    Li, Yulong
    Ma, Caipeng
    Yan, Xun
    Jiang, Dapeng
    OCEAN ENGINEERING, 2023, 268