Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach

被引:58
作者
Li, Lixin [1 ]
Cheng, Qianqian [1 ]
Tang, Xiao [1 ]
Bai, Tong [2 ]
Chen, Wei [3 ]
Ding, Zhiguo [4 ]
Han, Zhu [5 ,6 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[4] Univ Manchester, Sch Elect & Elect Engn, Manchester M13 9PL, Lancs, England
[5] Univ Houston, Dept ECE, Houston, TX 77004 USA
[6] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Task analysis; NOMA; Delays; Resource management; Energy consumption; Servers; Optimization; Multi-access edge computing; non-orthogonal multiple access; deep reinforcement learning; mean-field game; deep deterministic policy gradient; NONORTHOGONAL MULTIPLE-ACCESS; INTERNET;
D O I
10.1109/TWC.2020.3033843
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Attracted by the advantages of multi-access edge computing (MEC) and non-orthogonal multiple access (NOMA), this article studies the resource allocation problem of a NOMA-MEC system in an ultra-dense network (UDN), where each user may opt for offloading tasks to the MEC server when it is computationally intensive. Our optimization goal is to minimize the system computation cost, concerning the energy consumption and task delay of users. In order to tackle the non-convexity issue of the objective function, we decouple this problem into two sub-problems: user clustering as well as jointly power and computation resource allocation. Firstly, we propose a user clustering matching (UCM) algorithm exploiting the differences in channel gains of users. Then, relying on the mean-field game (MFG) framework, we solve the resource allocation problem for intensive user deployment, using the novel deep deterministic policy gradient (DDPG) method, which is termed by a mean-field-deep deterministic policy gradient (MF-DDPG) algorithm. Finally, a jointly iterative optimization algorithm (JIOA) of UCM and MF-DDPG is proposed to minimize the computation cost of users. The simulation results demonstrate that the proposed algorithm exhibits rapid convergence, and is capable of efficiently reducing both the energy consumption and task delay of users.
引用
收藏
页码:1487 / 1500
页数:14
相关论文
共 50 条
  • [1] Efficient Resource Allocation for NOMA-MEC System in Ultra-dense Network: A Mean Field Game Approach
    Cheng, Qianqian
    Li, Lixin
    Sun, Yan
    Wang, Dawei
    Liang, Wei
    Li, Xu
    Han, Zhu
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [2] Optimal Resource Allocation for Delay Minimization in NOMA-MEC Networks
    Fang, Fang
    Xu, Yanqing
    Ding, Zhiguo
    Shen, Chao
    Peng, Mugen
    Karagiannidis, George K.
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (12) : 7867 - 7881
  • [3] Mobility-Aware Offloading and Resource Allocation in NOMA-MEC Systems via DC
    Li, Changxiang
    Wang, Hong
    Song, Rongfang
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (05) : 1091 - 1095
  • [4] Energy-Efficient Resource Allocation for NOMA-MEC Networks With Imperfect CSI
    Fang, Fang
    Wang, Kaidi
    Ding, Zhiguo
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (05) : 3436 - 3449
  • [5] Mean-Field Game Based Edge Caching and Deleting Allocation in Ultra-Dense Networks
    Wang M.-Z.
    Teng Y.-L.
    Song M.
    Han D.-T.
    Zhang Y.
    Teng, Ying-Lei (lilytengtt@gmail.com), 1600, Beijing University of Posts and Telecommunications (43): : 29 - 39
  • [6] Computation Offloading and Resource Allocation in NOMA-MEC: A Deep Reinforcement Learning Approach
    Shang, Ce
    Sun, Yan
    Luo, Hong
    Guizani, Mohsen
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (17) : 15464 - 15476
  • [7] Distributed Data Offloading in Ultra-Dense LEO Satellite Networks: A Stackelberg Mean-Field Game Approach
    Wang, Dezhi
    Wang, Wei
    Kang, Yuhan
    Han, Zhu
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (01) : 112 - 127
  • [8] Age of Information in Ultra-Dense IoT Systems: Performance and Mean-Field Game Analysis
    Zhou, Bo
    Saad, Walid
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (05) : 4533 - 4547
  • [9] Joint Offloading Decision and Resource Allocation for Multiuser NOMA-MEC Systems
    Zhou, Wen'an
    Lin, Lixia
    Liu, Jianlong
    Zhang, Donglong
    Xie, Yifan
    IEEE ACCESS, 2019, 7 : 181100 - 181116
  • [10] Green grant-free power allocation for ultra-dense Internet of Things: A mean-field perspective
    Nadif, Sami
    Sabir, Essaid
    Elbiaze, Halima
    Haqiq, Abdelkrim
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 229