Dynamic task offloading for digital twin-empowered mobile edge computing via deep reinforcement learning

被引:41
|
作者
Chen, Ying [1 ]
Gu, Wei [1 ]
Xu, Jiajie [1 ]
Zhang, Yongchao [2 ]
Min, Geyong [2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Sch Comp, Beijing 100101, Peoples R China
[2] Univ Exeter, Exeter EX4 4QF, England
关键词
Task analysis; Internet of Things; Energy efficiency; Multi-access edge computing; Batteries; Artificial intelligence; Servers; mobile edge computing; deep reinforcement learning; digital twin; OPTIMIZATION; ARCHITECTURE; ALLOCATION; NETWORK;
D O I
10.23919/JCC.ea.2022-0372.202302
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Limited by battery and computing resources, the computing-intensive tasks generated by Internet of Things (IoT) devices cannot be processed all by themselves. Mobile edge computing (MEC) is a suitable solution for this problem, and the generated tasks can be offloaded from IoT devices to MEC. In this paper, we study the problem of dynamic task offloading for digital twin-empowered MEC. Digital twin techniques are applied to provide information of environment and share the training data of agent deployed on IoT devices. We formulate the task offloading problem with the goal of maximizing the energy efficiency and the workload balance among the ESs. Then, we reformulate the problem as an MDP problem and design DRL-based energy efficient task offloading (DEETO) algorithm to solve it. Comparative experiments are carried out which show the superiority of our DEETO algorithm in improving energy efficiency and balancing the workload.
引用
收藏
页码:164 / 175
页数:12
相关论文
共 50 条
  • [1] Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile-Edge Computing
    Fang, Juan
    Qu, Dezheng
    Chen, Huijie
    Liu, Yaqi
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (02): : 1403 - 1415
  • [2] Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems
    Tang, Ming
    Wong, Vincent W. S.
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2022, 21 (06) : 1985 - 1997
  • [3] AoI-Aware, Digital Twin-Empowered IoT Query Services in Mobile Edge Computing
    Li, Jing
    Guo, Song
    Liang, Weifa
    Wu, Jie
    Chen, Quan
    Xu, Zichuan
    Xu, Wenzheng
    Wang, Jianping
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (04) : 3636 - 3650
  • [4] Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    Yan, Jia
    Bi, Suzhi
    Zhang, Ying-Jun Angela
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (08) : 5404 - 5419
  • [5] Joint Offloading and Resource Allocation Using Deep Reinforcement Learning in Mobile Edge Computing
    Zhang, Xinjie
    Zhang, Xinglin
    Yang, Wentao
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3454 - 3466
  • [6] Task graph offloading via deep reinforcement learning in mobile edge computing
    Liu, Jiagang
    Mi, Yun
    Zhang, Xinyu
    Li, Xiaocui
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 158 : 545 - 555
  • [7] Digital Twin Assisted Task Offloading for Aerial Edge Computing and Networks
    Li, Bin
    Liu, Yufeng
    Tan, Ling
    Pan, Heng
    Zhang, Yan
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (10) : 10863 - 10877
  • [8] Joint Optimization of Task Offloading and Service Placement for Digital Twin empowered Mobile Edge Computing
    Chen, Tan
    Tan, Fuxing
    Ai, Jiahao
    Xiong, Xin
    Wu, Chenfang
    Ren, Xingtian
    PROCEEDINGS OF THE 2024 3RD INTERNATIONAL CONFERENCE ON NETWORKS, COMMUNICATIONS AND INFORMATION TECHNOLOGY, CNCIT 2024, 2024, : 132 - 137
  • [9] Secure Task Offloading in Blockchain-Enabled Mobile Edge Computing With Deep Reinforcement Learning
    Samy, Ahmed
    Elgendy, Ibrahim A.
    Yu, Haining
    Zhang, Weizhe
    Zhang, Hongli
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2022, 19 (04): : 4872 - 4887
  • [10] Multi-Agent Deep Reinforcement Learning for Task Offloading in UAV-Assisted Mobile Edge Computing
    Zhao, Nan
    Ye, Zhiyang
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (09) : 6949 - 6960