3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
|
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
来源
2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS | 2022年
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [31] Delay-Sensitive Energy-Efficient UAV Crowdsensing by Deep Reinforcement Learning
    Dai, Zipeng
    Liu, Chi Harold
    Han, Rui
    Wang, Guoren
    Leung, Kin K. K.
    Tang, Jian
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (04) : 2038 - 2052
  • [32] Collision-Free Deep Reinforcement Learning for Mobile Robots using Crash-Prevention Policy
    Kobelrausch, Markus D.
    Jantsch, Axel
    2021 7TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), 2021, : 52 - 59
  • [33] Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments
    Wang, Fei
    Zhu, Xiaoping
    Zhou, Zhou
    Tang, Yang
    CHINESE JOURNAL OF AERONAUTICS, 2024, 37 (03) : 237 - 257
  • [34] RIS-Assisted Energy-Efficient UAV Data Collection Method Based on Deep Reinforcement Learning
    Dong, Lu
    Lu, Mengjiao
    Wu, Yang
    Li, Xiaomeng
    Wu, Yongbao
    Yuan, Xin
    MOBILE NETWORKS & APPLICATIONS, 2025,
  • [35] A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems
    Chen, Miaojiang
    Liu, Wei
    Wang, Tian
    Zhang, Shaobo
    Liu, Anfeng
    KNOWLEDGE-BASED SYSTEMS, 2022, 235
  • [36] Energy-Efficient Joint Task Assignment and Migration in Data Centers: A Deep Reinforcement Learning Approach
    Lou, Jiong
    Tang, Zhiqing
    Jia, Weijia
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (02): : 961 - 973
  • [37] Energy-Efficient UAV Movement Control for Fair Communication Coverage: A Deep Reinforcement Learning Approach
    Nemer, Ibrahim A.
    Sheltami, Tarek R.
    Belhaiza, Slim
    Mahmoud, Ashraf S.
    SENSORS, 2022, 22 (05)
  • [38] Energy-Efficient Distributed Mobile Crowd Sensing: A Deep Learning Approach
    Liu, Chi Harold
    Chen, Zheyu
    Zhan, Yufeng
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (06) : 1262 - 1276
  • [39] Energy-Efficient Mode Selection and Resource Allocation for D2D-Enabled Heterogeneous Networks: A Deep Reinforcement Learning Approach
    Zhang, Tao
    Zhu, Kun
    Wang, Junhua
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (02) : 1175 - 1187
  • [40] An Energy-Efficient Dynamic Offloading Algorithm for Edge Computing Based on Deep Reinforcement Learning
    Zhu, Keyu
    Li, Shaobo
    Zhang, Xingxing
    Wang, Jinming
    Xie, Cankun
    Wu, Fengbin
    Xie, Rongxiang
    IEEE ACCESS, 2024, 12 : 127489 - 127506