Efficient End-Edge-Cloud Task Offloading in 6G Networks Based on Multiagent Deep Reinforcement Learning

被引:2
作者
She, Hao [1 ,2 ]
Yan, Lixing [1 ,2 ]
Guo, Yongan [1 ,2 ]
机构
[1] Nanjing Univ Posts & Telecommun, Minist Educ, Coll Telecommun & Informat Engn, Engn Res Ctr Hlth Serv Syst Based Ubiquitous Wirel, Nanjing 210003, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Edge Intelligence Res Inst, Nanjing 210003, Jiangsu, Peoples R China
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 11期
关键词
Task analysis; 6G mobile communication; Servers; Computational modeling; Cloud computing; Resource management; Delays; 6G; end-edge-cloud; multiagent deep reinforcement learning (MADRL); task offloading; RESOURCE-ALLOCATION; OPTIMIZATION; ARCHITECTURE; IOT;
D O I
10.1109/JIOT.2024.3372614
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the progressive evolution of the sixth-generation (6G) network, an array of diverse application tasks is experiencing a steady surge, consequently intensifying the computational pressure. However, even with highly optimized task offloading approaches, ensuring overall service quality for rapidly expanding network applications remains challenging due to hardware resource limitations. This article proposes a deep reinforcement learning-based algorithm utilizing a multiagent approach in the end-edge-cloud architecture for 6G networks. The offloading issue can be reformulated to a decentralized partially observable Markov decision process, which transfers the NP-hard problem. We design an efficient algorithm based on multiagent deep deterministic policy gradient (MADDPG) to observe the states of user equipments (UEs), edge servers, and cloud servers, thereby reducing offloading delay and energy consumption. Numerical results demonstrate that our proposed algorithm demonstrates superior performance compared to conventional and state-of-the-art approaches.
引用
收藏
页码:20260 / 20270
页数:11
相关论文
共 45 条
  • [1] LONG-RANGE COMMUNICATIONS IN UNLICENSED BANDS: THE RISING STARS IN THE IOT AND SMART CITY SCENARIOS
    Centenaro, Marco
    Vangelista, Lorenzo
    Zanella, Andrea
    Zorzi, Michele
    [J]. IEEE WIRELESS COMMUNICATIONS, 2016, 23 (05) : 60 - 67
  • [2] Robust Computation Offloading and Resource Scheduling in Cloudlet-Based Mobile Cloud Computing
    Chen, Menggang
    Guo, Songtao
    Liu, Kai
    Liao, Xiaofeng
    Xiao, Bin
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (05) : 2025 - 2040
  • [3] Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network
    Chen, Min
    Hao, Yixue
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (03) : 587 - 597
  • [4] Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning
    Chen, Xianfu
    Zhang, Honggang
    Wu, Celimuge
    Mao, Shiwen
    Ji, Yusheng
    Bennis, Mehdi
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03): : 4005 - 4018
  • [5] Energy-Efficient Task Offloading and Resource Allocation via Deep Reinforcement Learning for Augmented Reality in Mobile Edge Networks
    Chen, Xing
    Liu, Guizhong
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (13) : 10843 - 10856
  • [6] Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing
    Chen, Xu
    Jiao, Lei
    Li, Wenzhong
    Fu, Xiaoming
    [J]. IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) : 2827 - 2840
  • [7] Efficient Multi-Vehicle Task Offloading for Mobile Edge Computing in 6G Networks
    Chen, Ying
    Zhao, Fengjun
    Chen, Xin
    Wu, Yuan
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (05) : 4584 - 4595
  • [8] Dynamic Task Software Caching-Assisted Computation Offloading for Multi-Access Edge Computing
    Chen, Zhixiong
    Yi, Wenqiang
    Alam, Atm S.
    Nallanathan, Arumugam
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (10) : 6950 - 6965
  • [9] Space/Aerial-Assisted Computing Offloading for IoT Applications: A Learning-Based Approach
    Cheng, Nan
    Lyu, Feng
    Quan, Wei
    Zhou, Conghao
    He, Hongli
    Shi, Weisen
    Shen, Xuemin
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (05) : 1117 - 1129
  • [10] Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control
    Chu, Tianshu
    Wang, Jie
    Codeca, Lara
    Li, Zhaojian
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (03) : 1086 - 1095