Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach

被引:58
作者
Li, Lixin [1 ]
Cheng, Qianqian [1 ]
Tang, Xiao [1 ]
Bai, Tong [2 ]
Chen, Wei [3 ]
Ding, Zhiguo [4 ]
Han, Zhu [5 ,6 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[4] Univ Manchester, Sch Elect & Elect Engn, Manchester M13 9PL, Lancs, England
[5] Univ Houston, Dept ECE, Houston, TX 77004 USA
[6] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Task analysis; NOMA; Delays; Resource management; Energy consumption; Servers; Optimization; Multi-access edge computing; non-orthogonal multiple access; deep reinforcement learning; mean-field game; deep deterministic policy gradient; NONORTHOGONAL MULTIPLE-ACCESS; INTERNET;
D O I
10.1109/TWC.2020.3033843
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Attracted by the advantages of multi-access edge computing (MEC) and non-orthogonal multiple access (NOMA), this article studies the resource allocation problem of a NOMA-MEC system in an ultra-dense network (UDN), where each user may opt for offloading tasks to the MEC server when it is computationally intensive. Our optimization goal is to minimize the system computation cost, concerning the energy consumption and task delay of users. In order to tackle the non-convexity issue of the objective function, we decouple this problem into two sub-problems: user clustering as well as jointly power and computation resource allocation. Firstly, we propose a user clustering matching (UCM) algorithm exploiting the differences in channel gains of users. Then, relying on the mean-field game (MFG) framework, we solve the resource allocation problem for intensive user deployment, using the novel deep deterministic policy gradient (DDPG) method, which is termed by a mean-field-deep deterministic policy gradient (MF-DDPG) algorithm. Finally, a jointly iterative optimization algorithm (JIOA) of UCM and MF-DDPG is proposed to minimize the computation cost of users. The simulation results demonstrate that the proposed algorithm exhibits rapid convergence, and is capable of efficiently reducing both the energy consumption and task delay of users.
引用
收藏
页码:1487 / 1500
页数:14
相关论文
共 50 条
  • [21] Deep Reinforcement Learning Based Resource Allocation in Multi-UAV-Aided MEC Networks
    Chen, Jingxuan
    Cao, Xianbin
    Yang, Peng
    Xiao, Meng
    Ren, Siqiao
    Zhao, Zhongliang
    Wu, Dapeng Oliver
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2023, 71 (01) : 296 - 309
  • [22] Service Function Chaining in MEC: A Mean-Field Game and Reinforcement Learning Approach
    Abouaomar, Amine
    Cherkaoui, Soumaya
    Mlika, Zoubeir
    Kobbane, Abdellatif
    IEEE SYSTEMS JOURNAL, 2022, 16 (04): : 5357 - 5368
  • [23] Joint Task Offloading and Resource Allocation for Multi-Task Multi-Server NOMA-MEC Networks
    Xue, Jianbin
    An, Yaning
    IEEE ACCESS, 2021, 9 : 16152 - 16163
  • [24] Power Control Mean Field Game With Dominator in Ultra-Dense Small Cell Networks
    Yang, Chungang
    Zhang, Yue
    Li, Jiandong
    Han, Zhu
    GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [25] Cost-Aware Computation Offloading and Resource Allocation in Ultra-Dense Multi-Cell, Multi-User and Multi-Task MEC Networks
    Zhou, Tianqing
    Zeng, Xinliang
    Qin, Dong
    Jiang, Nan
    Nie, Xuefang
    Li, Chunguo
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (05) : 6642 - 6657
  • [26] Deep reinforcement learning-based task scheduling and resource allocation for NOMA-MEC in Industrial Internet of Things
    Lixia Lin
    Wen’an Zhou
    Zhicheng Yang
    Jianlong Liu
    Peer-to-Peer Networking and Applications, 2023, 16 : 170 - 188
  • [27] Resource Allocation in THz-NOMA-Enabled HAP Systems: A Deep Reinforcement Learning Approach
    Le, Mai
    Pham, Quoc-Viet
    Do, Quang Vinh
    Han, Zhu
    Hwang, Won-Joo
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (04) : 6808 - 6816
  • [28] A Deep Learning-Based Approach to Resource Allocation in UAV-aided Wireless Powered MEC Networks
    Feng, Wanmei
    Tang, Jie
    Zhao, Nan
    Zhang, Xiuyin
    Wang, Xianbin
    Wong, Kai-Kit
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [29] Mean-Field-Aided Multiagent Reinforcement Learning for Resource Allocation in Vehicular Networks
    Zhang, Hengxi
    Lu, Chengyue
    Tang, Huaze
    Wei, Xiaoli
    Liang, Le
    Cheng, Ling
    Ding, Wenbo
    Han, Zhu
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (03) : 2667 - 2679
  • [30] Grant-Free Power Allocation for Ultra-Dense IoT: A Mean Field Perspective
    Nadif, Sami
    Sabir, Essaid
    Elbiaze, Halima
    Haqiq, Abdelkrim
    2022 20TH MEDITERRANEAN COMMUNICATION AND COMPUTER NETWORKING CONFERENCE (MEDCOMNET), 2022,