Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning

被引:49
作者
Chen, Ying [1 ]
Gu, Wei [1 ]
Xu, Jiajie [1 ]
Zhang, Yongchao [2 ]
Min, Geyong [2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Sch Comp, Beijing 100101, Peoples R China
[2] Univ Exeter, Exeter EX4 4QF, England
关键词
Task analysis; Internet of Things; Energy efficiency; Multi-access edge computing; Batteries; Artificial intelligence; Servers; mobile edge computing; deep reinforcement learning; digital twin; OPTIMIZATION; ARCHITECTURE; ALLOCATION; NETWORK;
D O I
10.23919/JCC.ea.2022-0372.202302
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Limited by battery and computing resources, the computing-intensive tasks generated by Internet of Things (IoT) devices cannot be processed all by themselves. Mobile edge computing (MEC) is a suitable solution for this problem, and the generated tasks can be offloaded from IoT devices to MEC. In this paper, we study the problem of dynamic task offloading for digital twin-empowered MEC. Digital twin techniques are applied to provide information of environment and share the training data of agent deployed on IoT devices. We formulate the task offloading problem with the goal of maximizing the energy efficiency and the workload balance among the ESs. Then, we reformulate the problem as an MDP problem and design DRL-based energy efficient task offloading (DEETO) algorithm to solve it. Comparative experiments are carried out which show the superiority of our DEETO algorithm in improving energy efficiency and balancing the workload.
引用
收藏
页码:164 / 175
页数:12
相关论文
共 31 条
[1]   Heterogeneous Task Offloading and Resource Allocations via Deep Recurrent Reinforcement Learning in Partial Observable Multifog Networks [J].
Baek, Jungyeon ;
Kaddoum, Georges .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (02) :1041-1056
[2]  
Chen LJ, 2022, CHINA COMMUN, V19, P1, DOI 10.23919/JCC.2021.00.004
[3]  
Chen Y., 2022, China Communications
[4]   QoE-Aware Decentralized Task Offloading and Resource Allocation for End-Edge-Cloud Systems: A Game-Theoretical Approach [J].
Chen, Ying ;
Zhao, Jie ;
Wu, Yuan ;
Huang, Jiwei ;
Shen, Xuemin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) :769-784
[5]   QoS-Aware Computation Offloading in LEO Satellite Edge Computing for IoT: A Game-Theoretical Approach [J].
Chen, Ying ;
Hu, Jintao ;
Zhao, Jie ;
Min, Geyong .
CHINESE JOURNAL OF ELECTRONICS, 2024, 33 (04) :875-885
[6]   No-Pain No-Gain: DRL Assisted Optimization in Energy-Constrained CR-NOMA Networks [J].
Ding, Zhiguo ;
Schober, Robert ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) :5917-5932
[7]  
Fan B., 2022, IEEE WIREL COMMUN, P1
[8]   Digital Twin Empowered Mobile Edge Computing for Intelligent Vehicular Lane-Changing [J].
Fan, Bo ;
Wu, Yuan ;
He, Zhengbing ;
Chen, Yanyan ;
Quek, Tony Q. S. ;
Xu, Cheng-Zhong .
IEEE NETWORK, 2021, 35 (06) :194-201
[9]   Toward Intelligent Task Offloading at the Edge [J].
Guo, Hongzhi ;
Liu, Jiajia ;
Lv, Jianfeng .
IEEE NETWORK, 2020, 34 (02) :128-134
[10]   iTaskOffloading: Intelligent Task Offloading for a Cloud-Edge Collaborative System [J].
Hao, Yixue ;
Jiang, Yingying ;
Chen, Tao ;
Cao, Donggang ;
Chen, Min .
IEEE NETWORK, 2019, 33 (05) :82-88