Q-Learning Based Bidding Algorithm for Spectrum Auction in Cognitive Radio

被引:0
作者
Chen, Zhe [1 ]
Qiu, Robert C. [1 ]
机构
[1] Tennessee Technol Univ, Ctr Mfg Res, Dept Elect & Comp Engn, Cookeville, TN 38505 USA
来源
IEEE SOUTHEASTCON 2011: BUILDING GLOBAL ENGINEERS | 2011年
关键词
ACCESS;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cognitive radio has been put forward to make efficient use of scarce radio frequency spectrum. Once available frequency bands have been detected using spectrum sensing algorithms, spectrum auction can be employed to allocate the detected available frequency bands to secondary users. In this paper, a bidding algorithm based on Q-learning for secondary users is proposed. Secondary users employ the proposed algorithm to learn from their competitors and automatically place better bids for available frequency bands. Simulation result shows the proposed algorithm is effective. This work is a part of the efforts toward building a cognitive radio network testbed.
引用
收藏
页码:409 / 412
页数:4
相关论文
共 50 条
[21]   A Lightweight Algorithm for Probability-Based Spectrum Decision Scheme in Multiple Channels Cognitive Radio Networks [J].
Do, Cuong T. ;
Tran, Nguyen H. ;
Hong, Choong Seon ;
Lee, Sungwon ;
Lee, Jae-Jo ;
Lee, Wontae .
IEEE COMMUNICATIONS LETTERS, 2013, 17 (03) :509-512
[22]   CTMC Based Spectrum Sharing Scheme for Cognitive Radio Networks [J].
Patil, Kishor ;
Deshmukh, Madhukar ;
Cornean, Horia .
PROCEEDINGS OF THE 2010 8TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS (COMM), 2010, :509-512
[23]   Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm [J].
Tilwari, Valmik ;
Dimyati, Kaharudin ;
Hindia, M. H. D. Nour ;
Fattouh, Anas ;
Iraj Sadegh Amiri .
APPLIED SCIENCES-BASEL, 2019, 9 (08)
[24]   Resource allocation algorithm for downlink MIMO-OFDMA based cognitive radio networks in spectrum underlay scenario [J].
Mohammadi, Mahla ;
Hosseini Andargoli, Seyed Mehdi .
IET COMMUNICATIONS, 2020, 14 (11) :1812-1821
[25]   Spectrum Signals Handoff in LTE Cognitive Radio Networks Using Reinforcement Learning [J].
Babu, Kolluru Suresh ;
Vemuru, Srikanth .
TRAITEMENT DU SIGNAL, 2019, 36 (01) :119-125
[26]   Research on Maximal Weighted Independent Set-Based Graph Coloring Spectrum Allocation Algorithm in Cognitive Radio Networks [J].
Bao, Yuanyuan ;
Wang, Shubin ;
Yan, Bingxin ;
Liu, Kun ;
Meng, Fangfang .
PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, 2016, 386 :263-271
[27]   Dynamic Matching-Based Spectrum Detection in Cognitive Radio Networks [J].
Gu, Yu ;
Pei, Qingqi ;
Li, Hongning .
CHINA COMMUNICATIONS, 2019, 16 (04) :47-58
[28]   Cognitive Radio Spectrum Sensing Based on Index Belief Degree Function [J].
Liu, Meng-yun ;
Li, Shi-yin ;
Liu, Qiong .
2009 5TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-8, 2009, :1718-1721
[29]   A Leasing-based Spectrum Sharing Framework for Cognitive Radio Networks [J].
Handouf, Sara ;
Sabir, Essaid ;
Sadik, Mohammed .
2018 6TH INTERNATIONAL CONFERENCE ON WIRELESS NETWORKS AND MOBILE COMMUNICATIONS (WINCOM), 2018, :266-270
[30]   A Spectrum Handoff Scheme Based on Comprehensive Cost in Cognitive Radio System [J].
Wen Tianwei ;
Wang Yafeng ;
Li Chao .
2014 4TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, VEHICULAR TECHNOLOGY, INFORMATION THEORY AND AEROSPACE & ELECTRONIC SYSTEMS (VITAE), 2014,