Resource Allocation in D2D-Enabled 5G Networks Using Multiagent Reinforcement Learning

被引:0
|
作者
Agyekum, Kwame Opuni-Boachie Obour [1 ]
Boakye, Alex Yaw [1 ]
Appati, Benedict [1 ]
Opoku, Jochebed Akoto [1 ]
Agyemang, Justice Owusu [1 ]
Boateng, Gordon Owusu [2 ]
Gadze, James Dzisi [1 ]
机构
[1] Kwame Nkrumah Univ Sci & Technol, Dept Telecommun Engn, Kumasi, Ghana
[2] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chnegdu, Peoples R China
关键词
5G mobile communication systems - Complex networks - Computational complexity - Learning algorithms - Multi agent systems - Quality assurance - Quality of service - Queueing networks - Reinforcement learning - Resource allocation - Scalability - Signal to noise ratio;
D O I
10.1155/2024/2780845
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Device-to-device (D2D) communication is a promising technology in fifth-generation (5G) wireless networks, offering enhanced system capacity, spectrum performance, and energy efficiency. However, D2D links can introduce interference with cellular links, posing challenges in spectrum allocation and network quality assurance. This paper presents a novel approach using multiagent reinforcement learning with a proximal policy optimization algorithm to address the resource allocation problem in D2D networks. The proposed algorithm aims to optimize overall throughput and maximize the signal-to-interference noise ratio (SINR) while ensuring low computational complexity. The study introduces the following two key techniques: staggered training and decentralized execution. Staggered training improves agent performance and minimizes computational complexity by training agents one at a time in a sequential manner. This allows agents to learn from each other's mistakes and avoid local minima. Decentralized execution enhances scalability and system robustness by enabling agents to learn and act independently without relying on communication with other agents. In the event of agent failure, the remaining agents can continue operating. The findings of this work demonstrate a significant improvement in energy efficiency (EE) and an enhancement in the quality of service (QoS) of the network. Overall, the algorithm proves to be a promising solution for resource allocation in multiagent D2D networks, offering notable improvements in EE and QoS while maintaining scalability for large networks.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Deep Reinforcement Learning for Resource Allocation in 5G Communications
    Mau-Luen Tham
    Iqbal, Amjad
    Chang, Yoong Choon
    2019 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2019, : 1852 - 1855
  • [42] DISTRIBUTED RESOURCE ALLOCATION IN 5G NETWORKS WITH MULTI-AGENT REINFORCEMENT LEARNING
    Menard, Jon
    Al-Habashna, Ala'a
    Wainer, Gabriel
    Boudreau, Gary
    PROCEEDINGS OF THE 2022 ANNUAL MODELING AND SIMULATION CONFERENCE (ANNSIM'22), 2022, : 802 - 813
  • [43] Comparison of location-based and CSI-based resource allocation in D2D-enabled cellular networks
    Botsov, Mladen
    Stanczak, Slawomir
    Fertl, Peter
    2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2015, : 2529 - 2534
  • [44] Reinforcement Learning Approach for Resource Allocation in 5G HetNets
    Allagiotis, Fivos
    Bouras, Christos
    Kokkinos, Vasileios
    Gkamas, Apostolos
    Pouyioutas, Philippos
    2023 INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING, ICOIN, 2023, : 387 - 392
  • [45] Optimal Resource Block Assignment and Power Allocation for D2D-Enabled NOMA Communication
    Chen, Jian
    Jia, Jie
    Liu, Yuanwei
    Wang, Xingwei
    Aghvami, Abdol Hamid
    IEEE ACCESS, 2019, 7 : 90023 - 90035
  • [46] Sum Throughput Maximization Scheme for NOMA-Enabled D2D Groups Using Deep Reinforcement Learning in 5G and Beyond Networks
    Khan, Mohammad Aftab Alam
    Kaidi, Hazilah Mad
    Ahmad, Norulhusna
    Rehman, Masood Ur
    IEEE SENSORS JOURNAL, 2023, 23 (13) : 15046 - 15057
  • [47] Lyapunov optimization machine learning resource allocation approach for uplink underlaid D2D communication in 5G networks
    Pandey, Krishna
    Arya, Rajeev
    IET COMMUNICATIONS, 2022, 16 (05) : 476 - 484
  • [48] Energy-Aware Mode Selection for D2D Resource Allocation in 5G Networks
    Tsai, Hung-Chin
    Kao, Shang-Juh
    Huang, Ya-Ling
    Chang, Fu-Min
    ELECTRONICS, 2023, 12 (19)
  • [49] Path selection and resource allocation for 5G multi-hop D2D networks
    Teja, Panduranga Ravi
    Mishra, Pavan Kumar
    Computer Communications, 2022, 195 : 292 - 302
  • [50] Resource allocation algorithm for 5G and B5G D2D underlay wireless cellular networks
    Gopal, Malle
    Velmurugan, T.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (25) : 66841 - 66868