Resource Allocation in D2D-Enabled 5G Networks Using Multiagent Reinforcement Learning

被引:0
|
作者
Agyekum, Kwame Opuni-Boachie Obour [1 ]
Boakye, Alex Yaw [1 ]
Appati, Benedict [1 ]
Opoku, Jochebed Akoto [1 ]
Agyemang, Justice Owusu [1 ]
Boateng, Gordon Owusu [2 ]
Gadze, James Dzisi [1 ]
机构
[1] Kwame Nkrumah Univ Sci & Technol, Dept Telecommun Engn, Kumasi, Ghana
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chnegdu, Peoples R China
关键词
5G mobile communication systems - Complex networks - Computational complexity - Learning algorithms - Multi agent systems - Quality assurance - Quality of service - Queueing networks - Reinforcement learning - Resource allocation - Scalability - Signal to noise ratio;
D O I
10.1155/2024/2780845
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Device-to-device (D2D) communication is a promising technology in fifth-generation (5G) wireless networks, offering enhanced system capacity, spectrum performance, and energy efficiency. However, D2D links can introduce interference with cellular links, posing challenges in spectrum allocation and network quality assurance. This paper presents a novel approach using multiagent reinforcement learning with a proximal policy optimization algorithm to address the resource allocation problem in D2D networks. The proposed algorithm aims to optimize overall throughput and maximize the signal-to-interference noise ratio (SINR) while ensuring low computational complexity. The study introduces the following two key techniques: staggered training and decentralized execution. Staggered training improves agent performance and minimizes computational complexity by training agents one at a time in a sequential manner. This allows agents to learn from each other's mistakes and avoid local minima. Decentralized execution enhances scalability and system robustness by enabling agents to learn and act independently without relying on communication with other agents. In the event of agent failure, the remaining agents can continue operating. The findings of this work demonstrate a significant improvement in energy efficiency (EE) and an enhancement in the quality of service (QoS) of the network. Overall, the algorithm proves to be a promising solution for resource allocation in multiagent D2D networks, offering notable improvements in EE and QoS while maintaining scalability for large networks.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Distributed Channel Allocation for D2D-Enabled 5G Networks Using Potential Games
    Della Penda, Demia
    Abrardo, Andrea
    Moretti, Marco
    Johansson, Mikael
    IEEE ACCESS, 2019, 7 : 11195 - 11208
  • [2] Radio Resource Allocation for D2D-enabled Massive Machine Communication in the 5G Era
    Yang, Huitao
    Seet, Boon-Chong
    Hasan, Syed Faraz
    Chong, Peter Han Joo
    Chung, Min Young
    2016 IEEE 14TH INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, 14TH INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, 2ND INTL CONF ON BIG DATA INTELLIGENCE AND COMPUTING AND CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/DATACOM/CYBERSC, 2016, : 55 - 60
  • [3] Interference Avoidance Resource Allocation for D2D-Enabled 5G Narrowband Internet of Things
    Gbadamosi, Safiu A.
    Hancke, Gerhard P.
    Abu-Mahfouz, Adnan M.
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (22) : 22752 - 22764
  • [4] Federated Reinforcement Learning-Based Resource Allocation in D2D-Enabled 6G
    Guo, Qi
    Tang, Fengxiao
    Kato, Nei
    IEEE NETWORK, 2023, 37 (05): : 89 - 95
  • [5] Performance Analysis of D2D-Enabled 5G NR Networks
    Omri, Aymen
    Shaqfeh, Mohammad
    Mansouri, Majdi
    Al-Qahtani, Fawaz S.
    Alnuweiri, Hussein
    2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 306 - 312
  • [6] Resource Allocation in D2D-Enabled Cellular Networks Using Hierarchical Game
    Yuan, Pu
    Bi, Guoan
    2014 THIRD INTERNATIONAL CONFERENCE ON FUTURE GENERATION COMMUNICATION TECHNOLOGY (FGCT), 2014, : 60 - 65
  • [7] D2D-enabled resource management in secrecy-ensured 5G and beyond Heterogeneous networks
    Irrum, Fauzia
    Ali, Mudassar
    Naeem, Muhammad
    Anpalagan, Alagan
    Qaisar, Saad
    Qamar, Farhan
    PHYSICAL COMMUNICATION, 2021, 45
  • [8] Resource Allocation for Cooperative D2D-Enabled Wireless Caching Networks
    Liu, Jiaqi
    Guo, Shengjie
    Xiao, Sa
    Pan, Miao
    Zhou, Xiangwei
    Li, Geoffrey Ye
    Wu, Gang
    Li, Shaoqian
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [9] Uplink and Downlink Resource Allocation in D2D-Enabled Heterogeneous Networks
    Malandrino, Francesco
    Casetti, Claudio
    Chiasserini, Carla Fabiana
    Limani, Zana
    2014 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2014, : 87 - 92
  • [10] Energy-Efficient Mode Selection and Resource Allocation for D2D-Enabled Heterogeneous Networks: A Deep Reinforcement Learning Approach
    Zhang, Tao
    Zhu, Kun
    Wang, Junhua
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (02) : 1175 - 1187