3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
|
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
来源
2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS | 2022年
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 50 条
  • [41] Deep Reinforcement Learning for Intelligent Internet of Vehicles: An Energy-Efficient Computational Offloading Scheme
    Ning, Zhaolong
    Dong, Peiran
    Wang, Xiaojie
    Guo, Liang
    Rodrigues, Joel
    Kong, Xiangjie
    Huang, Jun
    Kwok, Ricky Y. K.
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (04) : 1060 - 1072
  • [42] Spiking Neural Network Discovers Energy-Efficient Hexapod Motion in Deep Reinforcement Learning
    Naya, Katsumi
    Kutsuzawa, Kyo
    Owaki, Dai
    Hayashibe, Mitsuhiro
    IEEE ACCESS, 2021, 9 (09): : 150345 - 150354
  • [43] Energy-Efficient Ultra-Dense Network With Deep Reinforcement Learning
    Ju, Hyungyu
    Kim, Seungnyun
    Kim, Youngjoon
    Shim, Byonghyo
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) : 6539 - 6552
  • [44] A DEEP REINFORCEMENT LEARNING APPROACH TO FLOCKING AND NAVIGATION OF UAVS IN LARGE-SCALE COMPLEX ENVIRONMENTS
    Wang, Chao
    Wang, Jian
    Zhang, Xudong
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 1228 - 1232
  • [45] Memory-enhanced deep reinforcement learning for UAV navigation in 3D environment
    Chenchen Fu
    Xueyong Xu
    Yuntao Zhang
    Yan Lyu
    Yu Xia
    Zining Zhou
    Weiwei Wu
    Neural Computing and Applications, 2022, 34 : 14599 - 14607
  • [46] Memory-enhanced deep reinforcement learning for UAV navigation in 3D environment
    Fu, Chenchen
    Xu, Xueyong
    Zhang, Yuntao
    Lyu, Yan
    Xia, Yu
    Zhou, Zining
    Wu, Weiwei
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17) : 14599 - 14607
  • [47] Energy-efficient heating control for smart buildings with deep reinforcement learning
    Gupta, Anchal
    Badr, Youakim
    Negahban, Ashkan
    Qiu, Robin G.
    JOURNAL OF BUILDING ENGINEERING, 2021, 34
  • [48] Deep Reinforcement Learning for Energy-efficient Train Operation of Automatic Driving
    Meng, Xianglin
    Wang, He
    Lin, Mu
    Zhou, Yonghua
    2020 IEEE 8TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2020, : 123 - 126
  • [49] Deep Reinforcement Learning for Energy-Efficient Federated Learning in UAV-Enabled Wireless Powered Networks
    Quang Vinh Do
    Quoc-Viet Pham
    Hwang, Won-Joo
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (01) : 99 - 103
  • [50] Communication-Efficient and Collision-Free Motion Planning of Underwater Vehicles via Integral Reinforcement Learning
    Yan, Jing
    Cao, Wenqiang
    Yang, Xian
    Chen, Cailian
    Guan, Xinping
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) : 8306 - 8320