Q-Learning Based Bidding Algorithm for Spectrum Auction in Cognitive Radio

被引:0
作者
Chen, Zhe [1 ]
Qiu, Robert C. [1 ]
机构
[1] Tennessee Technol Univ, Ctr Mfg Res, Dept Elect & Comp Engn, Cookeville, TN 38505 USA
来源
IEEE SOUTHEASTCON 2011: BUILDING GLOBAL ENGINEERS | 2011年
关键词
ACCESS;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cognitive radio has been put forward to make efficient use of scarce radio frequency spectrum. Once available frequency bands have been detected using spectrum sensing algorithms, spectrum auction can be employed to allocate the detected available frequency bands to secondary users. In this paper, a bidding algorithm based on Q-learning for secondary users is proposed. Secondary users employ the proposed algorithm to learn from their competitors and automatically place better bids for available frequency bands. Simulation result shows the proposed algorithm is effective. This work is a part of the efforts toward building a cognitive radio network testbed.
引用
收藏
页码:409 / 412
页数:4
相关论文
共 50 条
[31]   Topology Planning Using Q-Learning for Microwave-Based Wireless Backhaul Networks [J].
Li, Longfei ;
Li, Yongcheng ;
Bose, Sanjay Kumar ;
Shen, Gangxiang .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (04) :1041-1052
[32]   A Cognitive p-Persistent CSMA Scheme for Spectrum Sharing Based Cognitive Radio Networks [J].
Kang, Min Suk ;
Jung, Bang Chul .
2010 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC 2010), 2010,
[33]   Supervised machine learning techniques in cognitive radio networks during cooperative spectrum handovers [J].
Anandakumar, H. ;
Umamaheswari, K. .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2017, 20 (02) :1505-1515
[34]   Joint spectrum sensing and resource allocation optimization using genetic algorithm for frequency hopping-based cognitive radio networks [J].
Yoo, Sang-Jo ;
Shrestha, Anish Prasad ;
Seo, Myunghwan ;
Han, Chul-Hee ;
Park, Minho ;
Lee, Kwang-Eog .
INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2018, 31 (13)
[35]   Spectrum Allocation in Cognitive Radio Networks using Multi-Objective Differential Evolution Algorithm [J].
Anumandla, Kiran Kumar ;
Akella, Bharadwaj ;
Sabat, Samrat L. ;
Udgata, Siba K. .
2ND INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN) 2015, 2015, :264-269
[36]   Time Prediction Based Spectrum Usage Detection in Centralized Cognitive Radio Networks [J].
Ning, Guoqin ;
Nintanavongsa, Prusayon .
2012 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2012,
[37]   Cooperative Prediction-and-Sensing-Based Spectrum Sharing in Cognitive Radio Networks [J].
Van-Dinh Nguyen ;
Shin, Oh-Soon .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2018, 4 (01) :108-120
[38]   An Optimized Spectrum Transition Mechanism Based on Anticipation Probability for Cognitive Radio Systems [J].
Li Chao ;
Wang Yafeng ;
Chen Xianjin ;
Wen Tianwei .
2012 7TH INTERNATIONAL CONFERENCE ON COMPUTING AND CONVERGENCE TECHNOLOGY (ICCCT2012), 2012, :813-816
[39]   Sequential sensing based spectrum handoff in cognitive radio networks with multiple users [J].
Zhang, Wenjie ;
Yeo, Chai Kiat .
COMPUTER NETWORKS, 2014, 58 :87-98
[40]   PSO-Based Agent Cooperative Spectrum Sensing in Cognitive Radio Networks [J].
Chen, Jiexiong ;
Huang, Shasha ;
Li, Hongning ;
Lv, Xin ;
Cai, Ying .
IEEE ACCESS, 2019, 7 :142963-142973