Deep reinforcement learning-based multitask hybrid computing offloading for multiaccess edge computing

被引:31
作者
Cai, Jun [1 ]
Fu, Hongtian [1 ]
Liu, Yan [1 ]
机构
[1] Guangdong Polytech Normal Univ, Sch Cyber Secur, Guangzhou 510665, Guangzhong, Peoples R China
基金
中国国家自然科学基金;
关键词
deep reinforcement learning; edge computing; hybrid computing offloading; multitask; recurrent neural network; RESOURCE-ALLOCATION; COMPUTATION; MEC; OPTIMIZATION; MINIMIZATION; INTERNET;
D O I
10.1002/int.22841
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
By deploying computing units in edge servers, the device-generated computation-intensive tasks can be offloaded from the cloud, lessening the core network's traffic and reducing the tasks' completion latency. To mitigate the burden on edge server and improve user experience, this paper proposes a deep reinforcement learning (DRL)-based multiuser multitask hybrid computing offloading model for offloading a set of computation-intensive tasks generated by multiple users to edge server and adjacent devices. The proposed model makes global computing offloading decisions for multiple computation-intensive tasks simultaneously rather than via one-by-one decision-making, which takes the impact of users' offloading decisions on the system's overall performance in multitask offloading scenarios into account. The main goal of this study is to reduce the long-term overall system delay. The model uses the recurrent neural network to extract the feature information of task and network state, improving the convergence speed and stability of the DRL model. The experimental results demonstrate that the global offloading decision-making model outperforms other methods regarding long-term overall system delay and device energy consumption.
引用
收藏
页码:6221 / 6243
页数:23
相关论文
共 47 条
[1]   IEGA: An improved elitism-based genetic algorithm for task scheduling problem in fog computing [J].
Abdel-Basset, Mohamed ;
Mohamed, Reda ;
Chakrabortty, Ripon K. ;
Ryan, Michael J. .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2021, 36 (09) :4592-4631
[2]  
[Anonymous], 2018, P 2018 IEEE INT C CO, DOI DOI 10.1109/ICC.2018.8422317
[3]   A View of Cloud Computing [J].
Armbrust, Michael ;
Fox, Armando ;
Griffith, Rean ;
Joseph, Anthony D. ;
Katz, Randy ;
Konwinski, Andy ;
Lee, Gunho ;
Patterson, David ;
Rabkin, Ariel ;
Stoica, Ion ;
Zaharia, Matei .
COMMUNICATIONS OF THE ACM, 2010, 53 (04) :50-58
[4]   A Survey on Device-to-Device Communication in Cellular Networks [J].
Asadi, Arash ;
Wang, Qing ;
Mancuso, Vincenzo .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2014, 16 (04) :1801-1819
[5]   Task Execution Cost Minimization-Based Joint Computation Offloading and Resource Allocation for Cellular D2D MEC Systems [J].
Chai, Rong ;
Lin, Junliang ;
Chen, Minglong ;
Chen, Qianbin .
IEEE SYSTEMS JOURNAL, 2019, 13 (04) :4110-4121
[6]  
Chatzopoulos D., 2016, P IEEE INT S WORLD W, P1, DOI DOI 10.1109/WOWMOM.2016.7523497
[7]   D2D Task Offloading: A Dataset-Based Q&A [J].
Chatzopoulos, Dimitris ;
Bermejo, Carlos ;
ul Haq, Ehsan ;
Li, Yong ;
Hui, Pan .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (02) :102-107
[8]   SmartStore: A blockchain and clustering based intelligent edge storage system with fairness and resilience [J].
Chen, Haiwen ;
Yu, Jiaping ;
Zhou, Huan ;
Zhou, Tongqing ;
Liu, Fang ;
Cai, Zhiping .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2021, 36 (09) :5184-5209
[9]   Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing [J].
Chen, Xu ;
Jiao, Lei ;
Li, Wenzhong ;
Fu, Xiaoming .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) :2827-2840
[10]   NOMA-Based Multi-User Mobile Edge Computation Offloading via Cooperative Multi-Agent Deep Reinforcement Learning [J].
Chen, Zhao ;
Zhang, Lei ;
Pei, Yukui ;
Jiang, Chunxiao ;
Yin, Liuguo .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (01) :350-364