Deep Reinforcement Learning for Dynamic Spectrum Access in the Multi-Channel Wireless Local Area Networks

被引:3
|
作者
Bhandari, Sovit [1 ]
Ranjan, Navin [1 ]
Kim, Yeong-Chan [1 ]
Kim, Hoon [1 ]
机构
[1] Incheon Natl Univ, IoT & Big Data Res Ctr, Dept Elect Engn, Incheon, South Korea
基金
新加坡国家研究基金会;
关键词
WLANs; multi-channel; DSA; reinforcement learning; DQN; OPTIMALITY;
D O I
10.1109/ICEIC54506.2022.9748733
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, the rapid proliferation of wireless local area networks (WLANs) has led to a scarcity of radio spectrum. Dynamic Spectrum Access (DSA) is considered a promising technology to address the increasing shortage of radio spectrum and improve its utilization. DSA technique effectively utilizes the radio spectrum by switching between different networks. However, most conventional DSA techniques do not consider the correlation between multiple channels and require network information in advance to make decisions. Due to recent advances in reinforcement learning, a deep Q-network (DQN) based method is proposed in this paper to solve the problem of correlated multi-channel DSA with unknown system dynamics. The performance of the DQN-based method is quantified based on the successful packet transmission, packet collisions, and channel utilization.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Dynamic Spectrum Sensing and Aggregation in Multi-Channel Wireless Networks
    Li, Yunzeng
    Zhang, Wensheng
    Wang, Cheng-Xiang
    Sun, Jian
    Liu, Yu
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2020, 6 (02) : 464 - 475
  • [2] Dynamic Multi-channel Access in Wireless System with Deep Reinforcement Learning
    Li, Fan
    Zhu, Yun
    Xu, Youyun
    2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2020, : 283 - 287
  • [3] Deep Reinforcement Learning for Dynamic Spectrum Access in Wireless Networks
    Xu, Y.
    Yu, J.
    Headley, W. C.
    Buehrer, R. M.
    2018 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM 2018), 2018, : 207 - 212
  • [4] Deep Multi-User Reinforcement Learning for Dynamic Spectrum Access in Multichannel Wireless Networks
    Naparstek, Oshri
    Cohen, Kobi
    GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,
  • [5] Multi-Channel Opportunistic Access for Heterogeneous Networks Based on Deep Reinforcement Learning
    Ye, Xiaowen
    Yu, Yiding
    Fu, Liqun
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (02) : 794 - 807
  • [6] Multi-Agent Deep Learning for Multi-Channel Access in Slotted Wireless Networks
    Mennes, Ruben
    De Figueiredo, Felipe A. P.
    Latre, Steven
    IEEE ACCESS, 2020, 8 (08): : 95032 - 95045
  • [7] A multi-channel and multi-user dynamic spectrum access algorithm based on deep reinforcement learning in Cognitive Vehicular Networks with sensing error
    Chen, Lingling
    Fu, Ke
    Zhao, Quanjun
    Zhao, Xiaohui
    PHYSICAL COMMUNICATION, 2022, 55
  • [8] Deep-Reinforcement Learning for Fair Distributed Dynamic Spectrum Access in Wireless Networks
    Janiar, Siavash Barqi
    Pourahmadi, Vahid
    2021 IEEE 18TH ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2021,
  • [9] A Multi-Channel Testbed for Dynamic Spectrum Access (DSA) Networks
    Hsieh, Yi-Sheng
    Lien, Chia-Wei
    Chou, Chun-Ting
    WMUNEP 11: PROCEEDINGS OF THE SEVENTH ACM WORKSHOP ON WIRELESS MULTIMEDIA NETWORKING AND COMPUTING, 2011, : 63 - 66
  • [10] Dynamic Spectrum Access in Multi-Channel Cognitive Radio Networks
    Zhang, Ning
    Liang, Hao
    Cheng, Nan
    Tang, Yujie
    Mark, Jon W.
    Shen, Xuemin
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2014, 32 (11) : 2053 - 2064