Computation Bits Maximization in UAV-Assisted MEC Networks With Fairness Constraint

被引:39
作者
Zhou, Xiaoyi [1 ]
Huang, Liang [2 ]
Ye, Tong [1 ]
Sun, Weiqiang [1 ]
机构
[1] Shanghai Jiao Tong Univ, State Key Lab Adv Opt Commun Syst & Networks, Shanghai 200240, Peoples R China
[2] Zhejiang Univ Technol, Coll Comp Sci & Technol, Hangzhou 310058, Peoples R China
基金
中国国家自然科学基金;
关键词
Wireless communication; Resource management; Autonomous aerial vehicles; Trajectory; Wireless sensor networks; Task analysis; Servers; Fairness; mobile-edge computing (MEC); reinforcement learning; resource allocation; trajectory planning; unmanned aerial vehicle (UAV); wireless power transfer (WPT); TRAJECTORY DESIGN; WIRELESS;
D O I
10.1109/JIOT.2022.3177658
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article investigates an unmanned aerial vehicle (UAV)-assisted wireless-powered mobile-edge computing (MEC) system, where the UAV powers the mobile terminals by wireless power transfer (WPT) and provides computation service for them. We aim to maximize the computation bits of terminals while ensuring fairness among them. Considering the random trajectories of mobile terminals, we propose a soft actor-critic (SAC)-based UAV trajectory planning and resource allocation (SAC-TR) algorithm, which combines off-policy and maximum entropy reinforcement learning to improve the convergence of the algorithm. We design the reward as a heterogeneous function of computation bits, fairness, and destination. Simulation results show that SAC-TR can quickly adapt to varying network environments and outperform representative benchmarks in various situations.
引用
收藏
页码:20997 / 21009
页数:13
相关论文
共 38 条
[1]   Optimal LAP Altitude for Maximum Coverage [J].
Al-Hourani, Akram ;
Kandeepan, Sithamparanathan ;
Lardner, Simon .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2014, 3 (06) :569-572
[2]  
[Anonymous], 2011, P AIAA INF AER C
[3]   Mobility Models, Traces and Impact of Mobility on Opportunistic Routing Algorithms: A Survey [J].
Batabyal, Suvadip ;
Bhaumik, Parama .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2015, 17 (03) :1679-1707
[4]   Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks [J].
Bi, Suzhi ;
Huang, Liang ;
Wang, Hui ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) :7519-7537
[5]   Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading [J].
Bi, Suzhi ;
Zhang, Ying Jun .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) :4177-4190
[6]   Efficient 3-D Placement of an Aerial Base Station in Next Generation Cellular Networks [J].
Bor-Yaliniz, R. Irem ;
El-Keyi, Amr ;
Yanikomeroglu, Haiti .
2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
[7]   Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach [J].
Cheng, Nan ;
Lyu, Feng ;
Quan, Wei ;
Zhou, Conghao ;
He, Hongli ;
Shi, Weisen ;
Shen, Xuemin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (05) :1117-1129
[8]   Joint Resources and Workflow Scheduling in UAV-Enabled Wirelessly-Powered MEC for IoT Systems [J].
Du, Yao ;
Yang, Kun ;
Wang, Kezhi ;
Zhang, Guopeng ;
Zhao, Yizhe ;
Chen, Dongwei .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :10187-10200
[9]  
Haarnoja T, 2019, Arxiv, DOI arXiv:1812.05905
[10]  
Haarnoja T, 2018, PR MACH LEARN RES, V80