Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning

被引:78
作者
Zhang, Lu [1 ,2 ,3 ]
Zhang, Zi-Yan [1 ,2 ,3 ]
Min, Luo [5 ]
Tang, Chao [1 ,2 ,3 ]
Zhang, Hong-Ying [1 ,2 ,3 ]
Wang, Ya-Hong [1 ,2 ,3 ]
Cai, Peng [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Inst Urban Environm, Key Lab Urban Environm & Hlth, Xiamen 361021, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Xiamen Key Lab Phys Environm, Xiamen 361021, Peoples R China
[4] Chinese Acad Sci, Shanghai Inst Nutr & Hlth, Shanghai 200031, Peoples R China
[5] Univ Elect Sci & Technol China, State Key Lab Elect Thin Films & Integrated Devic, Chengdu 610054, Peoples R China
关键词
Task analysis; Computational modeling; Servers; Energy consumption; Trajectory; Reinforcement learning; Unmanned aerial vehicles; Computation offloading; deep learning; energy saving; mobile edge computing; reinforcement learning; unmanned aerial vehicle; RESOURCE-ALLOCATION; INTERNET;
D O I
10.1109/ACCESS.2021.3070908
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile Edge Computing (MEC) has been widely employed to support various Internet of Things (IoT) and mobile applications. By leveraging the advantages of easily deployed and flexibility of Unmanned Aerial Vehicle (UAV), one of MEC primary functions is employing UAVs equipped with MEC servers to provide computation supports for the offloaded tasks by mobile users in temporally hotspot areas or some emergent scenarios, such as sports game areas or destroyed by natural disaster areas. Despite the numerous advantages of UAV carried with a MEC server, it is restricted by its limited computation resources and sensitive energy consumption. Moreover, due to the complexity of UAV-assisted MEC system, its computational resource optimization and energy consumption optimization cannot be achieved well in traditional optimization methods. Furthermore, the computational cost of the MEC system optimization is often exponentially growing with the increase of the MEC servers and mobile users. Therefore, it is considerably challenging to control the UAV positions and schedule the task offloading ratio. In this paper, we proposed a novel Deep Reinforcement Learning (DRL) method to optimize UAV trajectory controlling and users' offloaded task ratio scheduling and improve the performance of the UAV-assisted MEC system. We maximized the system stability and minimized the energy consumption and computation latency of UAV-assisted the MEC system. The simulation results show that the proposed method outperforms existing work and has better scalability.
引用
收藏
页码:53708 / 53719
页数:12
相关论文
共 43 条
[1]   Mobile Edge Computing: A Survey [J].
Abbas, Nasir ;
Zhang, Yan ;
Taherkordi, Amir ;
Skeie, Tor .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (01) :450-465
[2]   Online Proactive Caching in Mobile Edge Computing Using Bidirectional Deep Recurrent Neural Network [J].
Ale, Laha ;
Zhang, Ning ;
Wu, Huici ;
Chen, Dajiang ;
Han, Tao .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :5520-5530
[3]   Efficient 3-D Placement of an Aerial Base Station in Next Generation Cellular Networks [J].
Bor-Yaliniz, R. Irem ;
El-Keyi, Amr ;
Yanikomeroglu, Haiti .
2016 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2016,
[4]   Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network [J].
Chen, Min ;
Hao, Yixue .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (03) :587-597
[5]  
Chen X., 2020, P IEEE 91 VEH TECHN, P1
[6]   Fair Data Allocation and Trajectory Optimization for UAV-Assisted Mobile Edge Computing [J].
Diao, Xianbang ;
Zheng, Jianchao ;
Cai, Yueming ;
Wu, Yuan ;
Anpalagan, Alagan .
IEEE COMMUNICATIONS LETTERS, 2019, 23 (12) :2357-2361
[7]   Joint Trajectory Design, Task Data, and Computing Resource Allocations for NOMA-Based and UAV-Assisted Mobile Edge Computing [J].
Diao, Xianbang ;
Zheng, Jianchao ;
Wu, Yuan ;
Cai, Yueming ;
Anpalagan, Alagan .
IEEE ACCESS, 2019, 7 :117448-117459
[8]   Towards Pervasive Augmented Reality: Context-Awareness in Augmented Reality [J].
Grubert, Jens ;
Langlotz, Tobias ;
Zollmann, Stefanie ;
Regenbrecht, Holger .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2017, 23 (06) :1706-1724
[9]   Deep Multiagent Reinforcement-Learning-Based Resource Allocation for Internet of Controllable Things [J].
Gu, Bo ;
Zhang, Xu ;
Lin, Ziqi ;
Alazab, Mamoun .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) :3066-3074
[10]   Toward the Internet of Things for Physical Internet: Perspectives and Challenges [J].
Hoa Tran-Dang ;
Krommenacker, Nicolas ;
Charpentier, Patrick ;
Kim, Dong-Seong .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (06) :4711-4736