Resource Allocation for NOMA-MEC Systems in Ultra-Dense Networks: A Learning Aided Mean-Field Game Approach

被引:58
作者
Li, Lixin [1 ]
Cheng, Qianqian [1 ]
Tang, Xiao [1 ]
Bai, Tong [2 ]
Chen, Wei [3 ]
Ding, Zhiguo [4 ]
Han, Zhu [5 ,6 ]
机构
[1] Northwestern Polytech Univ, Sch Elect & Informat, Xian 710129, Peoples R China
[2] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[4] Univ Manchester, Sch Elect & Elect Engn, Manchester M13 9PL, Lancs, England
[5] Univ Houston, Dept ECE, Houston, TX 77004 USA
[6] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 446701, South Korea
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Task analysis; NOMA; Delays; Resource management; Energy consumption; Servers; Optimization; Multi-access edge computing; non-orthogonal multiple access; deep reinforcement learning; mean-field game; deep deterministic policy gradient; NONORTHOGONAL MULTIPLE-ACCESS; INTERNET;
D O I
10.1109/TWC.2020.3033843
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Attracted by the advantages of multi-access edge computing (MEC) and non-orthogonal multiple access (NOMA), this article studies the resource allocation problem of a NOMA-MEC system in an ultra-dense network (UDN), where each user may opt for offloading tasks to the MEC server when it is computationally intensive. Our optimization goal is to minimize the system computation cost, concerning the energy consumption and task delay of users. In order to tackle the non-convexity issue of the objective function, we decouple this problem into two sub-problems: user clustering as well as jointly power and computation resource allocation. Firstly, we propose a user clustering matching (UCM) algorithm exploiting the differences in channel gains of users. Then, relying on the mean-field game (MFG) framework, we solve the resource allocation problem for intensive user deployment, using the novel deep deterministic policy gradient (DDPG) method, which is termed by a mean-field-deep deterministic policy gradient (MF-DDPG) algorithm. Finally, a jointly iterative optimization algorithm (JIOA) of UCM and MF-DDPG is proposed to minimize the computation cost of users. The simulation results demonstrate that the proposed algorithm exhibits rapid convergence, and is capable of efficiently reducing both the energy consumption and task delay of users.
引用
收藏
页码:1487 / 1500
页数:14
相关论文
共 50 条
  • [31] Resource Allocation In IRSs Aided MISO-NOMA Networks: A Machine Learning Approach
    Gao, Xinyu
    Liu, Yuanwei
    Liu, Xiao
    Qin, Zhijin
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [32] MEC Computation Offloading-Based Learning Strategy in Ultra-Dense Networks
    Duo, Chunhong
    Dong, Peng
    Gao, Qize
    Li, Baogang
    Li, Yongqian
    INFORMATION, 2022, 13 (06)
  • [33] User Association and Resource Allocation in Unified NOMA Enabled Heterogeneous Ultra Dense Networks
    Qin, Zhijin
    Yue, Xinwei
    Liu, Yuanwei
    Ding, Zhiguo
    Nallanathan, Arumugam
    IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (06) : 86 - 92
  • [34] A Model-Driven Deep Reinforcement Learning Heuristic Algorithm for Resource Allocation in Ultra-Dense Cellular Networks
    Liao, Xiaomin
    Shi, Jia
    Li, Zan
    Zhang, Lei
    Xia, Baiqiang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (01) : 983 - 997
  • [35] Resource allocation for energy efficient user association in user-centric ultra-dense networks integrating NOMA and beamforming
    Zhang, Long
    Zhang, Guobin
    Zhao, Xiaofang
    Li, Yali
    Huang, Chuntian
    Sun, Enchang
    Huang, Wei
    AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2020, 124
  • [36] Distributed Interference-Aware Power Control in Ultra-Dense Small Cell Networks: A Robust Mean Field Game
    Yang, Chungang
    Dai, Haoxiang
    Li, Jiandong
    Zhang, Yue
    Han, Zhu
    IEEE ACCESS, 2018, 6 : 12608 - 12619
  • [37] Hierarchical Matching Algorithm for Relay Selection in MEC-Aided Ultra-Dense UAV Networks
    Liang, Wei
    Ma, Shaobo
    Yang, Siyuan
    Zhang, Boxuan
    Gao, Ang
    DRONES, 2023, 7 (09)
  • [38] A Learning Aided Long-Term User Association Scheme for Ultra-Dense Networks
    Zhang, Biling
    Liu, Shaobo
    Yu, Jung-Lang
    Han, Zhu
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (01) : 820 - 830
  • [39] Computation Offloading and Resource Allocation in NOMA-MEC Enabled Aerial-Terrestrial Networks Exploiting mmWave Capabilities for 6G
    Umar, Amara
    Hassan, Syed Ali
    Jung, Haejoon
    ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, : 3256 - 3261
  • [40] An Analysis of Distributed Joint Spectrum Resource Allocation With Power Control in Ultra-Dense Cellular Networks
    Liu, Qiaoshou
    Zou, Jianwen
    Gu, Yingchen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (10) : 11201 - 11215