Multi-UAV Mobile Edge Computing and Path Planning Platform Based on Reinforcement Learning

被引:49
作者
Chang, Huan [1 ,2 ]
Chen, Yicheng [1 ]
Zhang, Baochang [1 ]
Doermann, David [3 ]
机构
[1] Beihang Univ, Beijing 100191, Peoples R China
[2] Imperial Coll London, Civil Engn Dept, South Kensington Campus, London SW7 2AZ, England
[3] Univ Buffalo, Buffalo, NY 14260 USA
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2022年 / 6卷 / 03期
关键词
Edge computing; Path planning; Quality of service; Planning; Task analysis; Reinforcement learning; Prediction algorithms; Unmanned Aerial Vehicle; Mobile Edge Computing; Path Planning; Reinforcement Learning; TRAJECTORY DESIGN;
D O I
10.1109/TETCI.2021.3083410
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned Aerial vehicles (UAVs) are widely used as network processors in mobile networks, but more recently, UAVs have been used in Mobile Edge Computing as mobile servers. However, there are significant challenges to use UAVs in complex environments with obstacles and cooperation between UAVs. We introduce a new multi-UAV Mobile Edge Computing platform, which aims to provide better Quality-of-Service and path planning based on reinforcement learning to address these issues. The contributions of our work include: 1) optimizing the quality of service for mobile edge computing and path planning in the same reinforcement learning framework; 2) using a sigmoid-like function to depict the terminal users' demand to ensure a higher quality of service; 3) applying synthetic considerations of the terminal users' demand, risk and geometric distance in reinforcement learning reward matrix to ensure the quality of service, risk avoidance, and the cost-savings. Simulations have shown the effectiveness and feasibility of our platform, which can help advance related researches. The source code can be found at https://github.com/bczhangbczhang.
引用
收藏
页码:489 / 498
页数:10
相关论文
共 21 条
[1]   Mobile Edge Computing: A Survey [J].
Abbas, Nasir ;
Zhang, Yan ;
Taherkordi, Amir ;
Skeie, Tor .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (01) :450-465
[2]  
Beck M.T., 2014, P 6 INT C ADV FUT IN, P48
[3]  
Cao XW, 2018, IEEE INT WORK SIGN P, P111
[4]   Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach [J].
Cheng, Nan ;
Lyu, Feng ;
Quan, Wei ;
Zhou, Conghao ;
He, Hongli ;
Shi, Weisen ;
Shen, Xuemin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (05) :1117-1129
[5]   Joint Resources and Workflow Scheduling in UAV-Enabled Wirelessly-Powered MEC for IoT Systems [J].
Du, Yao ;
Yang, Kun ;
Wang, Kezhi ;
Zhang, Guopeng ;
Zhao, Yizhe ;
Chen, Dongwei .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :10187-10200
[6]  
Faraci G, 2019, IEEE CONF COMPUT, P732, DOI [10.1109/INFCOMW.2019.8845316, 10.1109/infcomw.2019.8845316]
[7]   Survey of Important Issues in UAV Communication Networks [J].
Gupta, Lav ;
Jain, Raj ;
Vaszkun, Gabor .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2016, 18 (02) :1123-1152
[8]   Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing [J].
Huang, Liang ;
Feng, Xu ;
Zhang, Cheng ;
Qian, Liping ;
Wu, Yuan .
DIGITAL COMMUNICATIONS AND NETWORKS, 2019, 5 (01) :10-17
[9]   Mobile Edge Computing via a UAV-Mounted Cloudlet: Optimization of Bit Allocation and Path Planning [J].
Jeong, Seongah ;
Simeone, Osvaldo ;
Kang, Joonhyuk .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (03) :2049-2063
[10]   Coordinated trajectory planning for efficient communication relay using multiple UAVs [J].
Kim, Seungkeun ;
Oh, Hyondong ;
Suk, Jinyoung ;
Tsourdos, Antonios .
CONTROL ENGINEERING PRACTICE, 2014, 29 :42-49