NOMA Assisted Multi-Task Multi-Access Mobile Edge Computing via Deep Reinforcement Learning for Industrial Internet of Things

被引:134
作者
Qian, Liping [1 ,2 ]
Wu, Yuan [3 ,4 ]
Jiang, Fuli [3 ]
Yu, Ningning [1 ]
Lu, Weidang [1 ]
Lin, Bin [5 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou 310023, Zhejiang, Peoples R China
[2] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 210096, Peoples R China
[3] Univ Macau, State Key Lab Internet Things Smart City, Macau, Peoples R China
[4] Univ Macau, Dept Comp Informat Sci, Macau, Peoples R China
[5] Dalian Maritime Univ, Dept Commun Engn, Dalian 116026, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; NOMA; Resource management; Servers; Heuristic algorithms; Optimization; Edge computing; Deep reinforcement learning; energy consumption optimization; multi-access mobile edge computing; non-orthogonal multiple access; NONORTHOGONAL MULTIPLE-ACCESS; RESOURCE-MANAGEMENT; VEHICULAR NETWORKS; ENERGY-EFFICIENT; SERVICE; OPTIMIZATION; ALLOCATION; IOT;
D O I
10.1109/TII.2020.3001355
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multiaccess mobile edge computing (MA-MEC) has been envisioned as one of the key approaches for enabling computation-intensive yet delay-sensitive services in future industrial Internet of Things (IoT). In this article, we exploit nonorthogonal multiple access (NOMA) for computation offloading in MA-MEC and propose a joint optimization of the multiaccess multitask computation offloading, NOMA transmission, and computation-resource allocation, with the objective of minimizing the total energy consumption of IoT device to complete its tasks subject to the required latency limit. We first focus on a static channel scenario and propose a distributed algorithm to solve the joint optimization problem by identifying the layered structure of the formulated nonconvex problem. Furthermore, we consider a dynamic channel scenario in which the channel power gains from the IoT device to the edge-computing servers are time varying. To tackle with the difficulty due to the huge number of different channel realizations in the dynamic scenario, we propose an online algorithm, which is based on deep reinforcement learning (DRL), to efficiently learn the near-optimal offloading solutions for the time-varying channel realizations. Numerical results are provided to validate our distributed algorithm for the static channel scenario and the DRL-based online algorithm for the dynamic channel scenario. We also demonstrate the advantage of the NOMA assisted multitask MA-MEC against conventional orthogonal multiple access scheme under both static and dynamic channels.
引用
收藏
页码:5688 / 5698
页数:11
相关论文
共 35 条
[1]  
[Anonymous], IN PRESS, DOI DOI 10.1109/TII.2020.2978946
[2]   Energy-Efficient and Secure Resource Allocation for Multiple-Antenna NOMA With Wireless Power Transfer [J].
Chang, Zheng ;
Lei, Lei ;
Zhang, Huaqing ;
Ristaniemi, Tapani ;
Chatzinotas, Symeon ;
Ottersten, Bjorn ;
Han, Zhu .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2018, 2 (04) :1059-1071
[3]   Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning [J].
Chen, Xianfu ;
Zhang, Honggang ;
Wu, Celimuge ;
Mao, Shiwen ;
Ji, Yusheng ;
Bennis, Mehdi .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4005-4018
[4]   A Survey of Non-Orthogonal Multiple Access for 5G [J].
Dai, Linglong ;
Wang, Bichai ;
Ding, Zhiguo ;
Wang, Zhaocheng ;
Chen, Sheng ;
Hanzo, Lajos .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2018, 20 (03) :2294-2323
[5]   Delay Minimization for NOMA-MEC Offloading [J].
Ding, Zhiguo ;
Ng, Derrick Wing Kwan ;
Schober, Robert ;
Poor, H. Vincent .
IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (12) :1875-1879
[6]   Learning for Computation Offloading in Mobile Edge Computing [J].
Dinh, Thinh Quang ;
La, Quang Duy ;
Quek, Tony Q. S. ;
Shin, Hyundong .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2018, 66 (12) :6353-6367
[7]  
Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
[8]   Collaborative Computation Offloading for Multiaccess Edge Computing Over Fiber-Wireless Networks [J].
Guo, Hongzhi ;
Liu, Jiajia .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (05) :4514-4526
[9]   Deep Reinforcement Learning for Online Computation Offloading in Wireless Powered Mobile-Edge Computing Networks [J].
Huang, Liang ;
Bi, Suzhi ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2020, 19 (11) :2581-2593
[10]   Edge Computing Aware NOMA for 5G Networks [J].
Kiani, Abbas ;
Ansari, Nirwan .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (02) :1299-1306