Online Trajectory Optimization for Energy-Efficient Cellular-Connected UAVs With Map Reconstruction

被引:4
作者
Zhao, Haitao [1 ]
Hao, Qing [1 ]
Huang, Hao [1 ]
Gui, Guan [1 ]
Ohtsuki, Tomoaki [2 ]
Sari, Hikmet [1 ]
Adachi, Fumiyuki [3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Coll Telecommun & Informat Engn, Nanjing 210003, Peoples R China
[2] Keio Univ, Dept Informat & Comp Sci, Yokohama 2238522, Japan
[3] Tohoku Univ, Int Res Inst Disaster Sci IRIDeS, Sendai 9808577, Japan
关键词
Cellular-connected UAV; deep reinforcement learning; energy-efficient UAV; image reconstruction; radio map; trajectory design; WIRELESS NETWORKS; COMMUNICATION; DESIGN; SKY; LTE;
D O I
10.1109/TVT.2023.3323349
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this article, we leverage the outage probability knowledge map to characterize the connection between unmanned aerial vehicles (UAVs) and cellular networks. The outage probability knowledge map is a database that simulates the connection between UAV and the cellular network during real hovers, which helps to enhance the UAV's awareness of the environment and reduce the connection interruption under complex real-time channel state information. We assume that the UAV roughly samples from the actual radio environment of the airspace in advance, and calculates the outage probability of the sampled points. After that, the UAV reconstructs the actual outage knowledge map, and flies in the airspace to learn the optimal UAV trajectory planning policy based on the reconstructed map. The optimization objective is to minimize the flight energy cost of the UAV performing tasks. In this article, we propose a deep image prior based radio map reconstruction (DIPRMR) method to reconstruct the map, and then propose a deep reinforcement learning based trajectory optimization algorithm. The UAV that performs the task adjusts the flight trajectory based on the outage probability knowledge obtained from the reconstructed complete map. Simulation results show that the proposed online trajectory optimization scheme based on outage probability knowledge map can obtain great returns in terms of maintaining connectivity, reducing task completion time and energy consumption.
引用
收藏
页码:3445 / 3456
页数:12
相关论文
共 39 条
[1]   The New Frontier in RAN Heterogeneity: Multi-Tier Drone-Cells [J].
Bor-Yaliniz, Irem ;
Yanikomeroglu, Halim .
IEEE COMMUNICATIONS MAGAZINE, 2016, 54 (11) :48-55
[2]  
Bulut I., 2018, P IEEE INT C COMM WO, P1
[3]   Multi-UAV Trajectory and Power Optimization for Cached UAV Wireless Networks With Energy and Content Recharging-Demand Driven Deep Learning Approach [J].
Chai, Shuqi ;
Lau, Vincent K. N. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (10) :3208-3224
[4]   Trajectory Design and Resource Allocation for Multi-UAV Networks: Deep Reinforcement Learning Approaches [J].
Chang, Zheng ;
Deng, Hengwei ;
You, Li ;
Min, Geyong ;
Garg, Sahil ;
Kaddoum, Georges .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05) :2940-2951
[5]   Joint Trajectory Design and BS Association for Cellular-Connected UAV: An Imitation-Augmented Deep Reinforcement Learning Approach [J].
Chen, Yu-Jia ;
Huang, Da-Yu .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (04) :2843-2858
[6]  
Denkovski D, 2014, IEEE CONF COMPUT, P155, DOI 10.1109/INFCOMW.2014.6849202
[7]   Three-Dimensional-Map-Based Trajectory Design in UAV-Aided Wireless Localization Systems [J].
Esrafilian, Omid ;
Gangula, Rajeev ;
Gesbert, David .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12) :9894-9904
[8]   3D-Map Assisted UAV Trajectory Design Under Cellular Connectivity Constraints [J].
Esrafilian, Omid ;
Gangula, Rajeev ;
Gesbert, David .
ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
[9]   Learning to Communicate in UAV-Aided Wireless Networks: Map-Based Approaches [J].
Esrafilian, Omid ;
Gangula, Rajeev ;
Gesbert, David .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02) :1791-1802
[10]   A Social Vulnerability Index for Disaster Management [J].
Flanagan, Barry E. ;
Gregory, Edward W. ;
Hallisey, Elaine J. ;
Heitgerd, Janet L. ;
Lewis, Brian .
JOURNAL OF HOMELAND SECURITY AND EMERGENCY MANAGEMENT, 2011, 8 (01)