Cognitive Radio Network Throughput Maximization with Deep Reinforcement Learning

被引:0
作者
Ong, Kevin Shen Hoong [1 ]
Zhang, Yang [1 ]
Niyato, Dusit [1 ]
机构
[1] Nanyang Technol Univ Singapore, Sch Comp Sci & Engn, Singapore, Singapore
来源
2019 IEEE 90TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2019-FALL) | 2019年
关键词
D O I
10.1109/vtcfall.2019.8891294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Radio Frequency powered Cognitive Radio Networks (RF-CRN) are likely to be the eyes and ears of upcoming modern networks such as Internet of Things (IoT), requiring increased decentralization and autonomous operation. To be considered autonomous, the RF-powered network entities need to make decisions locally to maximize the network throughput under the uncertainty of any network environment. However, in complex and large-scale networks, the state and action spaces are usually large, and existing Tabular Reinforcement Learning technique is unable to find the optimal state-action policy quickly. In this paper, deep reinforcement learning is proposed to overcome the mentioned shortcomings and allow a wireless gateway to derive an optimal policy to maximize network throughput. When benchmarked against advanced DQN techniques, our proposed DQN configuration offers performance speedup of up to 1.8x with good overall performance.
引用
收藏
页数:5
相关论文
共 17 条
  • [1] Anh T. T., 2018, ARXIV181004520
  • [2] Choi SH, 2015, ASIA-PAC CONF COMMUN, P370, DOI 10.1109/APCC.2015.7412542
  • [3] The Tradeoff Analysis in RF-Powered Backscatter Cognitive Radio Networks
    Dinh Thai Hoang
    Niyato, Dusit
    Wang, Ping
    Kim, Dong In
    Han, Zhu
    [J]. 2016 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2016,
  • [4] Ambient Backscatter: A New Approach to Improve Network Performance for RF-Powered Cognitive Radio Networks
    Dinh Thai Hoang
    Niyato, Dusit
    Wang, Ping
    Kim, Dong In
    Han, Zhu
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 2017, 65 (09) : 3659 - 3674
  • [5] Bandpass mismatch error for satellite CMB experiments I: estimating the spurious signal
    Duc Thuong Hoang
    Patanchon, Guillaume
    Bucher, Martin
    Matsumura, Tomotake
    Banerji, Ranajoy
    Ishino, Hirokazu
    Hazumi, Masashi
    Delabrouille, Jacques
    [J]. JOURNAL OF COSMOLOGY AND ASTROPARTICLE PHYSICS, 2017, (11):
  • [6] Gao X., 2019, IEEE T WIRELESS COMM
  • [7] Hybrid Backscatter Communication for Wireless-Powered Heterogeneous Networks
    Kim, Sung Hoon
    Kim, Dong In
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2017, 16 (10) : 6557 - 6570
  • [8] Opportunistic Wireless Energy Harvesting in Cognitive Radio Networks
    Lee, Seunghyun
    Zhang, Rui
    Huang, Kaibin
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (09) : 4788 - 4799
  • [9] Li YL, 2016, 2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), P1995
  • [10] AMBIENT BACKSCATTER ASSISTED WIRELESS POWERED COMMUNICATIONS
    Lu, Xiao
    Niyato, Dusit
    Jiang, Hai
    Kim, Dong In
    Xiao, Yong
    Han, Zhu
    [J]. IEEE WIRELESS COMMUNICATIONS, 2018, 25 (02) : 170 - 177