Deep Reinforcement Learning for Trajectory Generation and Optimisation of UAVs

被引:1
|
作者
Akhtar, Mishma [1 ]
Maqsood, Adnan [1 ]
Verbeke, Mathias [2 ]
机构
[1] Natl Univ Sci & Technol, Sch Interdisciplinary Engn & Sci, Islamabad, Pakistan
[2] Katholieke Univ Leuven, Dept Comp Sci, M Grp, Flanders Make KU Leuven, Brugge, Belgium
关键词
Reinforcement learning; Deep Deterministic Policy Gradient; Quadcopter; Control; Continual learning; ALGORITHM;
D O I
10.1109/RAST57548.2023.10197856
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
In recent years, the rapid advancements in Machine Learning have led to substantial research in control systems for autonomous aerial vehicles. Particularly, Reinforcement Learning (RL) has attracted a lot of attention for the design and development of such control algorithms. This paper examines the control issues of autonomous flight and how these are addressed using RL approaches. The objective is to investigate how RL algorithms like Deep Deterministic Policy Gradient may be applied particularly for control actions in an unmanned aerial vehicle (UAV). This learning paradigm acts as a mechanism that continuously generates policies for tasks such as attitude and position control, which converges into an optimized trajectory. As an outlook, the application of Continual Reinforcement Learning is proposed. This is a novel RL methodology that holds the potential to advance the control system of a UAV operating in dynamic, unknown environments with the ability to reapply learnt behavior and flexibly adapt to new situations.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Deep reinforcement learning-based reactive trajectory planning method for UAVs
    Cao, Lijia
    Wang, Lin
    Liu, Yang
    Xu, Weihong
    Geng, Chuang
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2024, 238 (10) : 1018 - 1037
  • [2] Distributed Trajectory Design for Cooperative Internet of UAVs Using Deep Reinforcement Learning
    Hu, Jingzhi
    Zhang, Hongliang
    Bian, Kaigui
    Song, Lingyang
    Han, Zhu
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [3] Formal Verification for Safe Deep Reinforcement Learning in Trajectory Generation
    Corsi, Davide
    Marchesini, Enrico
    Farinelli, Alessandro
    Fiorini, Paolo
    2020 FOURTH IEEE INTERNATIONAL CONFERENCE ON ROBOTIC COMPUTING (IRC 2020), 2020, : 352 - 359
  • [4] Cooperative Internet of UAVs: Distributed Trajectory Design by Multi-Agent Deep Reinforcement Learning
    Hu, Jingzhi
    Zhang, Hongliang
    Song, Lingyang
    Schober, Robert
    Poor, H. Vincent
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (11) : 6807 - 6821
  • [5] Application of Deep Reinforcement Learning in UAVs : A Review
    Wang, Ruihui
    Xuh, Li
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 4096 - 4103
  • [6] An Efficient Deep Reinforcement Learning Framework for UAVs
    Zhou, Shanglin
    Li, Bingbing
    Ding, Caiwu
    Lu, Lu
    Ding, Caiwen
    PROCEEDINGS OF THE TWENTYFIRST INTERNATIONAL SYMPOSIUM ON QUALITY ELECTRONIC DESIGN (ISQED 2020), 2020, : 323 - 328
  • [7] Reinforcement Learning for Energy-Efficient Trajectory Design of UAVs
    Arani, Atefeh Hajijamali
    Azari, M. Mahdi
    Hu, Peng
    Zhu, Yeying
    Yanikomeroglu, Halim
    Safavi-Naeini, Safieddin
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (11): : 9060 - 9070
  • [8] Trajectory and Communication Design for Cache- Enabled UAVs in Cellular Networks: A Deep Reinforcement Learning Approach
    Ji, Jiequ
    Zhu, Kun
    Cai, Lin
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (10) : 6190 - 6204
  • [9] 3D UAV Trajectory and Data Collection Optimisation Via Deep Reinforcement Learning
    Nguyen, Khoi Khac
    Duong, Trung Q.
    Tan Do-Duy
    Claussen, Holger
    Hanzo, Lajos
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (04) : 2358 - 2371
  • [10] Proactive Handover Decision for UAVs with Deep Reinforcement Learning
    Jang, Younghoon
    Raza, Syed M.
    Kim, Moonseong
    Choo, Hyunseung
    SENSORS, 2022, 22 (03)