Deep Reinforcement Learning for Spectrum Sharing in Future Mobile Communication System

被引:0
|
作者
Liu, Sizhuang [1 ]
Wang, Tengjiao [1 ]
Pan, Changyong [1 ,2 ]
Zhang, Chao [1 ,2 ]
Yang, Fang [1 ,2 ]
Song, Jian [1 ,2 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
来源
2021 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB) | 2021年
基金
国家重点研发计划;
关键词
Resources allocation; machine learning for communications; dynamic spectrum access; deep reinforcement learning; deep Q-network; ACCESS;
D O I
10.1109/BMSB53066.2021.9547161
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, the rapid growth of mobile communication services makes spectrum resources become increasingly scarce. This paper considers the multi-dimensional resource allocation problem in unlicensed spectrum communication system. A training method based on deep reinforcement learning is proposed to generate a spectrum sharing and power control strategy for secondary users in the communication system. Deep Q-Network and Deep Recurrent Q-Network are chosen as the structure of neural network. Experiments are conducted to investigate the effectiveness of the algorithm. The results show that collision rate decreases in training while average reward rises.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Dynamic Spectrum Sharing Based on Deep Reinforcement Learning in Mobile Communication Systems
    Liu, Sizhuang
    Pan, Changyong
    Zhang, Chao
    Yang, Fang
    Song, Jian
    SENSORS, 2023, 23 (05)
  • [2] Intelligent spectrum sharing for train-to-train communication based on deep reinforcement learning
    Zhao, Junhui
    Chen, Yao
    Zhang, Qingmiao
    Journal of Railway Science and Engineering, 2022, 19 (03) : 841 - 848
  • [3] Deep Reinforcement Learning for Dynamic Spectrum Sharing of LTE and NR
    Challita, Ursula
    Sandberg, David
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [4] Power Control Based on Deep Reinforcement Learning for Spectrum Sharing
    Zhang, Haijun
    Ning Yang
    Wei Huangfu
    Long, Keping
    Leung, Victor C. M.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (06) : 4209 - 4219
  • [5] Spectrum Sharing of Mobile Network Operators based on Deep Reinforcement Learning in 5G and beyond
    Hsu, Yi-Huai
    Chang, Chen-Fan
    Lee, Chao-Hung
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 2278 - 2283
  • [6] Dynamic Spectrum Sharing and Aggregation Scheme Based on Deep Reinforcement Learning
    Sheng, Tianqi
    Zhang, Wensheng
    Ding, Wenjiao
    Sun, Jian
    Wang, Cheng-Xiang
    2022 INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING, IWCMC, 2022, : 290 - 294
  • [7] A Deep Reinforcement Learning Framework for Contention-Based Spectrum Sharing
    Doshi, Akash
    Yerramalli, Srinivas
    Ferrari, Lorenzo
    Yoo, Taesang
    Andrews, Jeffrey G.
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (08) : 2526 - 2540
  • [8] Smooth Deep Reinforcement Learning for Power Control for Spectrum Sharing in Cognitive Radios
    Dang, Lujuan
    Wang, Wanli
    Tse, Chi K. K.
    Lau, Francis C. M.
    Wang, Shiyuan
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (12) : 10621 - 10632
  • [9] Deep Reinforcement Learning for Cognitive Radar Spectrum Sharing: A Continuous Control Approach
    Flandermeyer, Shane A.
    Mattingly, Rylee G.
    Metcalf, Justin G.
    IEEE Transactions on Radar Systems, 2024, 2 : 125 - 137
  • [10] Deep Reinforcement Learning for Cooperative Edge Caching in Future Mobile Networks
    Li, Ding
    Han, Yiwen
    Wang, Chenyang
    Shi, GaoTao
    Wang, Xiaofei
    Li, Xiuhua
    Leung, Victor C. M.
    2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2019,