3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
|
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
来源
2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS | 2022年
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [21] Energy-Efficient Collision-Free Trajectory Planning Using Alternating Quadratic Programming
    Zhao, Yiming
    Wang, Yebin
    Bortoff, Scott A.
    Nikovski, Daniel
    2014 AMERICAN CONTROL CONFERENCE (ACC), 2014, : 1249 - 1254
  • [22] Energy Efficient 3-D UAV Control for Persistent Communication Service and Fairness: A Deep Reinforcement Learning Approach
    Qi, Hang
    Hu, Zhiqun
    Huang, Hao
    Wen, Xiangming
    Lu, Zhaoming
    IEEE ACCESS, 2020, 8 : 53172 - 53184
  • [23] A UAV Navigation Approach Based on Deep Reinforcement Learning in Large Cluttered 3D Environments
    Xue, Yuntao
    Chen, Weisheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (03) : 3001 - 3014
  • [24] Hierarchical Planning with Deep Reinforcement Learning for 3D Navigation of Microrobots in Blood Vessels
    Yang, Yuguang
    Bevan, Michael A.
    Li, Bo
    ADVANCED INTELLIGENT SYSTEMS, 2022, 4 (11)
  • [25] Energy-Efficient Parking Analytics System using Deep Reinforcement Learning
    Rezaei, Yoones
    Lee, Stephen
    Mosse, Daniel
    BUILDSYS'21: PROCEEDINGS OF THE 2021 ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILT ENVIRONMENTS, 2021, : 81 - 90
  • [26] Peduncle collision-free grasping based on deep reinforcement learning for tomato harvesting robot
    Li, Yajun
    Feng, Qingchun
    Zhang, Yifan
    Peng, Chuanlang
    Ma, Yuhang
    Liu, Cheng
    Ru, Mengfei
    Sun, Jiahui
    Zhao, Chunjiang
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 216
  • [27] Joint power allocation and MCS selection for energy-efficient link adaptation: A deep reinforcement learning approach
    Parsa, Ali
    Moghim, Neda
    Salavati, Pouyan
    COMPUTER NETWORKS, 2022, 218
  • [28] Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach
    Nie, Yiwen
    Zhao, Junhui
    Liu, Jun
    Jiang, Jing
    Ding, Ruijin
    CHINA COMMUNICATIONS, 2020, 17 (10) : 129 - 141
  • [29] Energy-efficient VM scheduling based on deep reinforcement learning
    Wang, Bin
    Liu, Fagui
    Lin, Weiwei
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 125 : 616 - 628
  • [30] Deep Reinforcement Learning Based Efficient and Robust Navigation Method For Autonomous Applications
    Hemming, Nathan
    Menon, Vineetha
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 287 - 293