Multiuser Data Dissemination in OFDMA System Based on Deep Q-Network

被引:0
作者
Xing, Yuan [1 ]
Pan, Haowen [2 ]
Xu, Bin [2 ]
Zhao, Tianchi [3 ]
Tapparello, Cristiano [4 ]
Qian, Yuchen [5 ]
机构
[1] Univ Wisconsin Stout, Dept Engn & Technol, Menomonie, WI 54751 USA
[2] Shanghai Legit Network Technol Co Ltd, Shanghai, Peoples R China
[3] Univ Arizona, Dept Elect & Comp Engn, Tucson, AZ 85721 USA
[4] Univ Rochester, Dept Elect & Comp Engn, Rochester, NY 14627 USA
[5] Baylor Univ, Dept Elect & Comp Engn, Waco, TX 76706 USA
来源
2021 IEEE INTERNATIONAL IOT, ELECTRONICS AND MECHATRONICS CONFERENCE (IEMTRONICS) | 2021年
关键词
OFDMA; Energy efficiency; Data dissemination; Global optimization; Deep Q-Network; RESOURCE-ALLOCATION;
D O I
10.1109/IEMTRONICS52119.2021.9422644
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, a multiuser data dissemination problem is analyzed in an orthogonal frequency division multiple access(OFDMA) downlink system. By dynamically allocating subchannels and power to the mobile users, the system aims to minimize the time consumption in order to successfully deliver data to multiple mobile users under the restriction of total energy consumption. Both the objective and the constraint of the optimization are related to the real-time resource allocation strategies. Moreover, neither the statistics nor the full channel state information is known to the base station. In order to solve the global optimization problem with partial channel information, a Deep Q-Network algorithm is adopted. The numerical results show that compared with the other algorithms, Deep Q-Network can learn the optimal resource allocation strategies and achieve very good system performance.
引用
收藏
页码:175 / 180
页数:6
相关论文
共 12 条
  • [1] Dong L, 2016, IEEE ONL CONF GREEN, P13, DOI 10.1109/OnlineGreenCom.2016.7805400
  • [2] Foerster JN, 2016, ADV NEUR IN, V29
  • [3] COMPLEXITY OF VEHICLE-ROUTING AND SCHEDULING PROBLEMS
    LENSTRA, JK
    KAN, AHGR
    [J]. NETWORKS, 1981, 11 (02) : 221 - 227
  • [4] Li H, 2018, IEEE GLOBE WORK
  • [5] Energy-Efficient Subcarrier Assignment and Power Allocation in OFDMA Systems With Max-Min Fairness Guarantees
    Li, Yuzhou
    Sheng, Min
    Tan, Chee Wei
    Zhang, Yan
    Sun, Yuhua
    Wang, Xijun
    Shi, Yan
    Li, Jiandong
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2015, 63 (09) : 3183 - 3195
  • [6] Spectrum Sharing in Vehicular Networks Based on Multi-Agent Reinforcement Learning
    Liang, Le
    Ye, Hao
    Li, Geoffrey Ye
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (10) : 2282 - 2292
  • [7] Van Hasselt H, 2016, AAAI, V2, P5
  • [8] Optimal resource allocation for parallel Gaussian broadcast channels: Minimum rate constraints and sum power minimization
    Wunder, Gerhard
    Michel, Thomas
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (12) : 4817 - 4822
  • [9] Energy-Efficient Resource Allocation in OFDMA Networks
    Xiong, Cong
    Li, Geoffrey Ye
    Zhang, Shunqing
    Chen, Yan
    Xu, Shugong
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2012, 60 (12) : 3767 - 3778
  • [10] Xu ZY, 2017, IEEE ICC