Efficient End-Edge-Cloud Task Offloading in 6G Networks Based on Multiagent Deep Reinforcement Learning

被引:2
作者
She, Hao [1 ,2 ]
Yan, Lixing [1 ,2 ]
Guo, Yongan [1 ,2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Minist Educ, Coll Telecommun & Informat Engn, Engn Res Ctr Hlth Serv Syst Based Ubiquitous Wirel, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Edge Intelligence Res Inst, Nanjing 210003, Jiangsu, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 11期
关键词
Task analysis; 6G mobile communication; Servers; Computational modeling; Cloud computing; Resource management; Delays; 6G; end-edge-cloud; multiagent deep reinforcement learning (MADRL); task offloading; RESOURCE-ALLOCATION; OPTIMIZATION; ARCHITECTURE; IOT;
D O I
10.1109/JIOT.2024.3372614
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the progressive evolution of the sixth-generation (6G) network, an array of diverse application tasks is experiencing a steady surge, consequently intensifying the computational pressure. However, even with highly optimized task offloading approaches, ensuring overall service quality for rapidly expanding network applications remains challenging due to hardware resource limitations. This article proposes a deep reinforcement learning-based algorithm utilizing a multiagent approach in the end-edge-cloud architecture for 6G networks. The offloading issue can be reformulated to a decentralized partially observable Markov decision process, which transfers the NP-hard problem. We design an efficient algorithm based on multiagent deep deterministic policy gradient (MADDPG) to observe the states of user equipments (UEs), edge servers, and cloud servers, thereby reducing offloading delay and energy consumption. Numerical results demonstrate that our proposed algorithm demonstrates superior performance compared to conventional and state-of-the-art approaches.
引用
收藏
页码:20260 / 20270
页数:11
相关论文
共 45 条
  • [31] Cooperative Computation Offloading for Multi-Access Edge Computing in 6G Mobile Networks via Soft Actor Critic
    Sun, Chuan
    Wu, Xiongwei
    Li, Xiuhua
    Fan, Qilin
    Wen, Junhao
    Leung, Victor C. M.
    [J]. IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06): : 5601 - 5614
  • [32] Sun Z., 2021, P IEEE INT C COMM IC, P1
  • [33] A Deep Reinforcement Learning-Based Dynamic Traffic Offloading in Space-Air-Ground Integrated Networks (SAGIN)
    Tang, Fengxiao
    Hofner, Hans
    Kato, Nei
    Kaneko, Kazuma
    Yamashita, Yasutaka
    Hangai, Masatake
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (01) : 276 - 289
  • [34] Joint Offloading and Computing Optimization in Wireless Powered Mobile-Edge Computing Systems
    Wang, Feng
    Xu, Jie
    Wang, Xin
    Cui, Shuguang
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (03) : 1784 - 1797
  • [35] Traffic and Computation Co-Offloading With Reinforcement Learning in Fog Computing for Industrial Applications
    Wang, Yixuan
    Wang, Kun
    Huang, Huawei
    Miyazaki, Toshiaki
    Guo, Song
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (02) : 976 - 986
  • [36] Multi-Agent Deep Reinforcement Learning for Urban Traffic Light Control in Vehicular Networks
    Wu, Tong
    Zhou, Pan
    Liu, Kai
    Yuan, Yali
    Wang, Xiumin
    Huang, Huawei
    Wu, Dapeng Oliver
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (08) : 8243 - 8256
  • [37] Reinforcement Learning-Based Mobile Offloading for Edge Computing Against Jamming and Interference
    Xiao, Liang
    Lu, Xiaozhen
    Xu, Tangwei
    Wan, Xiaoyue
    Ji, Wen
    Zhang, Yanyong
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (10) : 6114 - 6126
  • [38] Energy-Efficient Resource Allocation for Mobile-Edge Computation Offloading
    You, Changsheng
    Huang, Kaibin
    Chae, Hyukjin
    Kim, Byoung-Hoon
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2017, 16 (03) : 1397 - 1411
  • [39] Provably Efficient Resource Allocation for Edge Service Entities Using Hermes
    Zhang, Sheng
    Liang, Yu
    Ge, Jidong
    Xiao, Mingjun
    Wu, Jie
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2020, 28 (04) : 1684 - 1697
  • [40] Energy-Optimal Mobile Cloud Computing under Stochastic Wireless Channel
    Zhang, Weiwen
    Wen, Yonggang
    Guan, Kyle
    Kilper, Dan
    Luo, Haiyun
    Wu, Dapeng Oliver
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (09) : 4569 - 4581