Q-Learning Based Bidding Algorithm for Spectrum Auction in Cognitive Radio

被引:0
作者
Chen, Zhe [1 ]
Qiu, Robert C. [1 ]
机构
[1] Tennessee Technol Univ, Ctr Mfg Res, Dept Elect & Comp Engn, Cookeville, TN 38505 USA
来源
IEEE SOUTHEASTCON 2011: BUILDING GLOBAL ENGINEERS | 2011年
关键词
ACCESS;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cognitive radio has been put forward to make efficient use of scarce radio frequency spectrum. Once available frequency bands have been detected using spectrum sensing algorithms, spectrum auction can be employed to allocate the detected available frequency bands to secondary users. In this paper, a bidding algorithm based on Q-learning for secondary users is proposed. Secondary users employ the proposed algorithm to learn from their competitors and automatically place better bids for available frequency bands. Simulation result shows the proposed algorithm is effective. This work is a part of the efforts toward building a cognitive radio network testbed.
引用
收藏
页码:409 / 412
页数:4
相关论文
共 50 条
[41]   A Bilateral-Market based Mechanism for Spectrum Allocation in Cognitive Radio Networks [J].
Nadendla, V. Sriram Siddhardh ;
Brahma, Swastik ;
Varshney, Pramod K. .
2013 IEEE 5TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2013), 2013, :444-447
[42]   Spectrum Sharing in MIMO Cognitive Radio Networks Based on Cooperative Game Theory [J].
Liu, Yanqing ;
Dong, Liang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2014, 13 (09) :4807-4820
[43]   Throughput optimization using availability analysis based spectrum sensing for a cognitive radio [J].
Bagchi, Srijibendu ;
Siddiqui, Jawad Yaseen .
AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2018, 85 :12-22
[44]   Blockchain-Based Security Enhancement and Spectrum Sensing in Cognitive Radio Network [J].
Khanna, Ashish ;
Rani, Poonam ;
Sheikh, Tariq Hussain ;
Gupta, Deepak ;
Kansal, Vineet ;
Rodrigues, Joel J. P. C. .
WIRELESS PERSONAL COMMUNICATIONS, 2022, 127 (03) :1899-1921
[45]   Improving Energy Efficiency and QoS of LPWANs for IoT Using Q-Learning Based Data Routing [J].
Pandey, Om Jee ;
Yuvaraj, Tankala ;
Paul, Joseph K. ;
Nguyen, Ha H. ;
Gundepudi, Karthikay ;
Shukla, Mahendra K. .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (01) :365-379
[46]   A Distributed Learning Automata Scheme for Spectrum Management in Self-Organized Cognitive Radio Network [J].
Fahimi, Mina ;
Ghasemi, Abdorasoul .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2017, 16 (06) :1490-1501
[47]   A Cooperative Spectrum Sensing With Multi-Agent Reinforcement Learning Approach in Cognitive Radio Networks [J].
Gao, Ang ;
Du, Chengyuan ;
Ng, Soon Xin ;
Liang, Wei .
IEEE COMMUNICATIONS LETTERS, 2021, 25 (08) :2604-2608
[48]   CLUSTERING AND REINFORCEMENT-LEARNING-BASED ROUTING FOR COGNITIVE RADIO NETWORKS [J].
Saleem, Yasir ;
Yau, Kok-Lim Alvin ;
Mohamad, Hafizal ;
Ramli, Nordin ;
Rehmani, Mubashir Husain ;
Ni, Qiang .
IEEE WIRELESS COMMUNICATIONS, 2017, 24 (04) :146-151
[49]   Decomposition Based Multiobjective Spectrum Allocation Algorithm for Cognitive Vehicular Networks [J].
Zhang, Ruining ;
Jiang, Xuemei ;
Li, Ruifang .
2017 17TH IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT 2017), 2017, :831-836
[50]   Decentralized Spectrum Selection Algorithm to Consider Hardware Constraints in Cognitive Radio Ad-hoc Networks [J].
Kim, Bosung ;
Nguyen Manh Tuan ;
Roh, Byeong-hee ;
Kim, Dae-Young ;
Park, Soo Bum .
2013 15TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY (ICACT), 2013, :755-759