3D Autonomous Navigation of UAVs: An Energy-Efficient and Collision-Free Deep Reinforcement Learning Approach

被引:1
作者
Wang, Yubin [1 ]
Biswas, Karnika [1 ]
Zhang, Liwen [2 ]
Ghazzai, Hakim [1 ]
Massoud, Yehia [1 ]
机构
[1] King Abdullah Univ Sci & Technol KAUST, Innovat Technol Labs, Thuwal, Saudi Arabia
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110004, Peoples R China
来源
2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS, APCCAS | 2022年
关键词
Deep reinforcement learning; unmanned aerial vehicles; motion planning; autonomous navigation; energy efficiency;
D O I
10.1109/APCCAS55924.2022.10090255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Energy consumption optimization is crucial for the navigation of Unmanned Aerial Vehicles (UAV), as they operate solely on battery power and have limited access to charging stations. In this paper, a novel deep reinforcement learning-based architecture has been proposed for planning energy-efficient and collision-free paths for a quadrotor UAV. The proposed method uses a unique combination of remaining flight distance and local knowledge of energy expenditure to compute an optimized route. An information graph is used to map the environment in three dimensions and obstacles inside a pre-determined neighbourhood of the UAV are removed to obtain a local as well as collision-free reachable space. Attention-based neural network forms the key element of the proposed reinforcement learning mechanism, that trains the UAV to autonomously generate the optimized route using partial knowledge of the environment, following the trajectories from which, the UAV is driven by the trajectory tracking controller.
引用
收藏
页码:404 / 408
页数:5
相关论文
共 20 条
[1]   Spatial and Temporal Management of Cellular HetNets with Multiple Solar Powered Drones [J].
Alsharoa, Ahmad ;
Ghazzai, Hakim ;
Kadri, Abdullah ;
Kamal, Ahmed E. .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (04) :954-968
[2]   Low-Altitude Navigation for Multi-Rotor Drones in Urban Areas [J].
Bahabry, Ahmed ;
Wan, Xiangpeng ;
Ghazzai, Hakim ;
Menouar, Hamid ;
Vesonder, Gregg ;
Massoud, Yehia .
IEEE ACCESS, 2019, 7 :87716-87731
[3]  
Bewald L., 2020, EXPT TRACKING WEIGHT
[4]   A Generic Spatiotemporal Scheduling for Autonomous UAVs: A Reinforcement Learning-Based Approach [J].
Bouhamed, Omar ;
Ghazzai, Hakim ;
Besbes, Hichem ;
Massoud, Yehia .
IEEE OPEN JOURNAL OF VEHICULAR TECHNOLOGY, 2020, 1 :93-106
[5]  
Cao Y., 2021, ARXIV
[6]   Vehicle Routing Problems for Drone Delivery [J].
Dorling, Kevin ;
Heinrichs, Jordan ;
Messier, Geoffrey G. ;
Magierowski, Sebastian .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (01) :70-85
[7]  
Dwivedi VP, 2021, Arxiv, DOI arXiv:2012.09699
[8]  
Geraerts R, 2003, SPRINGER TRAC ADV RO, V7, P43
[9]  
Imanberdiyev N., 2016, 2016 14 INT C CONTR, P1
[10]   Energetics in robotic flight at small scales [J].
Karydis, Konstantinos ;
Kumar, Vijay .
INTERFACE FOCUS, 2017, 7 (01)