MADRL Based Uplink Joint Resource Block Allocation and Power Control in Multi-Cell Systems

被引：0

作者：

Yang, Yuhan ^{[1
]}

Lv, Tiejun ^{[1
]}

Cui, Yingping ^{[1
]}

Huang, Pingmu ^{[1
]}

机构：

[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Minist Educ, Key Lab Trustworthy Distributed Comp & Serv, Beijing 100876, Peoples R China

来源：

2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC | 2023年

基金：

中国国家自然科学基金; 北京市自然科学基金;

关键词：

Resource allocation; power control; uplink; double deep Q network (DDQN); multi-agent deep reinforcement learning (MADRL);

D O I：

10.1109/WCNC55385.2023.10119106

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Intelligent resource allocation and power control schemes are regarded as important methods to alleviate the problems caused by the sharp increase in the number of users and operating costs. In this paper, we propose a multi-agent deep reinforcement learning (MADRL)-based algorithm to jointly optimize resource block (RB) allocation and power control, which aims to maximize the average spectrum efficiency (SE) of the system while meeting quality of service (QoS) constraints. In view of the fact that centralized training distributed execution retains the advantages of centralized training while reducing the amount of computation and signaling overhead, the MADRL technique can be adopted. In the proposed MADRL model, the Q function of each agent is aggregated through the value decomposition network, which strengthens the cooperation of agents and improves the convergence of the algorithm. We add a reward discount network into the original MADRL framework to adaptively adjust the attention to future rewards according to the performance of agents in the training process. Simulation experiments show that the proposed algorithm has better performance and stability than the existing alternatives.

引用

页数：6