Energy-Efficient UAV Trajectory Design for Backscatter Communication: A Deep Reinforcement Learning Approach

被引:0
作者
Nie, Yiwen [1 ]
Zhao, Junhui [1 ,2 ]
Liu, Jun [3 ,4 ]
Jiang, Jing [5 ]
Ding, Ruijin [6 ,7 ,8 ]
机构
[1] Beijing Jioatong Univ, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] East China Jiaotong Univ, Sch Informat Engn, Nanchang 330013, Jiangxi, Peoples R China
[3] Tsinghua Univ, Inst Network Sci & Cyberspace, Beijing 100084, Peoples R China
[4] Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
[5] Xian Univ Posts & Telecommun, Shaanxi Key Lab Informat Commun Network & Secur, Xian 710121, Peoples R China
[6] Tsinghua Univ THUAI, Inst Artificial Intelligence, Beijing 100084, Peoples R China
[7] Tsinghua Univ, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[8] Tsinghua Univ, Beijing Natl Res Ctr Infonnat Sci & Technol BNRis, Dept Automat, Beijing 100084, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
unmanned aerial vehicle (UAV); trajectory design; backscatter communication; deep reinforcement learning; energy-efficient; RESOURCE-ALLOCATION; OPTIMIZATION; PARADIGM; INTERNET; IOT; 5G;
D O I
暂无
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Recently, backscatter communication (BC) has been introduced as a green paradigm for Internet of Things (IoT). Meanwhile, unmanned aerial vehicles (UAVs) can serve as aerial base stations (BSs) to enhance the performance of BC system thanks to their high mobility and flexibility. In this paper, we investigate the problem of energy efficiency (EE) for an energy-limited backscatter communication (BC) network, where backscatter devices (BDs) on the ground harvest energy from the wireless signal of a flying rotary-wing quadrotor. Specifically, we first reformulate the EE optimization problem as a Markov decision process (MDP) and then propose a deep reinforcement learning (DRL) algorithm to design the UAV trajectory with the constraints of the BD scheduling, the power reflection coefficients, the transmission power, and the fairness among BDs. Simulation results show the proposed DRL algorithm achieves close-to-optimal performance and significant EE gains compared to the benchmark schemes.
引用
收藏
页码:129 / 141
页数:13
相关论文
共 39 条
[1]  
[Anonymous], 2015, Financial reporting with XBRL and its impact on the accounting profession
[2]   A Comprehensive Review of the COVID-19 Pandemic and the Role of IoT, Drones, AI, Blockchain, and 5G in Managing its Impact [J].
Chamola, Vinay ;
Hassija, Vikas ;
Gupta, Vatsal ;
Guizani, Mohsen .
IEEE ACCESS, 2020, 8 :90225-90265
[3]   Multiple UAVs as Relays: Multi-Hop Single Link Versus Multiple Dual-Hop Links [J].
Chen, Yunfei ;
Zhao, Nan ;
Ding, Zhiguo ;
Alouini, Mohamed-Slim .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (09) :6348-6359
[4]  
Farajzadeh A, 2019, IEEE ICC, DOI 10.1109/icc.2019.8761125
[5]   An Introduction to Deep Reinforcement Learning [J].
Francois-Lavet, Vincent ;
Henderson, Peter ;
Islam, Riashat ;
Bellemare, Marc G. ;
Pineau, Joelle .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2018, 11 (3-4) :219-354
[6]   Throughput Maximization for UAV-Aided Backscatter Communication Networks [J].
Hua, Meng ;
Yang, Luxi ;
Li, Chunguo ;
Wu, Qingqing ;
Swindlehurst, A. Lee .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (02) :1254-1270
[7]   Riding on the Primary: A New Spectrum Sharing Paradigm for Wireless-Powered IoT Devices [J].
Kang, Xin ;
Liang, Ying-Chang ;
Yang, Jing .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (09) :6335-6347
[8]   Opportunistic Ambient Backscatter Communication in RF-Powered Cognitive Radio Networks [J].
Kishore, Rajalekshmi ;
Gurugopinath, Sanjeev ;
Sofotasios, Paschalis C. ;
Muhaidat, Sami ;
Al-Dhahir, Naofal .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (02) :413-426
[9]   Joint Optimization on Trajectory, Altitude, Velocity, and Link Scheduling for Minimum Mission Time in UAV-Aided Data Collection [J].
Li, Jiaxun ;
Zhao, Haitao ;
Wang, Haijun ;
Gu, Fanglin ;
Wei, Jibo ;
Yin, Hao ;
Ren, Baoquan .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (02) :1464-1475
[10]   Throughput Optimization for Cognitive UAV Networks: A Three-Dimensional-Location-Aware Approach [J].
Liang, Xiaopeng ;
Xu, Wenjun ;
Gao, Hui ;
Pan, Miao ;
Lin, Jiaru ;
Deng, Qian ;
Zhang, Ping .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (07) :948-952