Improving Reinforcement Learning Algorithms for Dynamic Spectrum Allocation in Cognitive Sensor Networks

被引:0
作者
Faganello, Leonardo Roveda [1 ]
Kunst, Rafael [1 ]
Both, Cristiano Bonato [1 ]
Granville, Lisandro Zambenedetti [1 ]
Rochol, Juergen [1 ]
机构
[1] Univ Fed Rio Grande do Sul, BR-90046900 Porto Alegre, RS, Brazil
来源
2013 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC) | 2013年
关键词
RESOURCE-ALLOCATION; RADIO NETWORKS; MANAGEMENT; SYSTEM;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Cognitive Radio Networks enable a higher number of users to access the spectrum of frequency simultaneously. This access is possible due to the implementation of dynamic spectrum allocation algorithms. In this context, one of the main algorithms found in the literature is the reinforcement learning based approach called Q-Learning. Although been widely applied, this algorithm does not take into account accurate information about the behavior of users neither the channel propagation conditions. In this sense, we propose three improvements to the dynamic spectrum allocation algorithms based on reinforcement learning for cognitive sensor networks. Simulation results show that all the proposed algorithms allow allocating channels with up to 6dB better quality and 4% higher efficiency than Q-Learning.
引用
收藏
页码:35 / 40
页数:6
相关论文
共 14 条
[1]   A survey on spectrum management in cognitive radio networks [J].
Akyildiz, Ian F. ;
Lee, Won-Yeol ;
Vuran, Mehmet C. ;
Mohanty, Shantidev .
IEEE COMMUNICATIONS MAGAZINE, 2008, 46 (04) :40-48
[2]  
[Anonymous], 2001, WIRELESS COMMUNICATI
[3]   A Framework for Statistical Wireless Spectrum Occupancy Modeling [J].
Ghosh, Chittabrata ;
Pagadarai, Srikanth ;
Agrawal, Dharma P. ;
Wyglinski, Alexander M. .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2010, 9 (01) :38-44
[4]   Efficient exploration in reinforcement learning-based cognitive radio spectrum sharing [J].
Jiang, T. ;
Grace, D. ;
Mitchell, P. D. .
IET COMMUNICATIONS, 2011, 5 (10) :1309-1317
[5]   Channel Management in IEEE 802.22 WRAN Systems [J].
Ko, Gwangzeen ;
Franklin, A. Antony ;
You, Sung-Jin ;
Pak, Jin-Suk ;
Song, Myung-Sun ;
Kim, Chang-Joo .
IEEE COMMUNICATIONS MAGAZINE, 2010, 48 (09) :88-94
[6]   Cognitive radio: Making software radios more personal [J].
Mitola, J ;
Maguire, GQ .
IEEE PERSONAL COMMUNICATIONS, 1999, 6 (04) :13-18
[7]   WirelessHART Field Devices [J].
Muller, Ivan ;
Netto, Joao Cesar ;
Pereira, Carlos Eduardo .
IEEE INSTRUMENTATION & MEASUREMENT MAGAZINE, 2011, 14 (06) :20-25
[8]   A COGNITIVE RADIO SYSTEM FOR E-HEALTH APPLICATIONS IN A HOSPITAL ENVIRONMENT [J].
Phunchongharn, Phond ;
Hossain, Ekram ;
Niyato, Dusit ;
Camorlinga, Sergio .
IEEE WIRELESS COMMUNICATIONS, 2010, 17 (01) :20-28
[9]   Emerging Cognitive Radio Applications: A Survey [J].
Wang, Jianfeng ;
Ghosh, Monisha ;
Challapali, Kiran .
IEEE COMMUNICATIONS MAGAZINE, 2011, 49 (03) :74-81
[10]  
WATKINS CJCH, 1992, MACH LEARN, V8, P279, DOI 10.1007/BF00992698