An efficient transmission mode selection based on reinforcement learning for cooperative cognitive radio networks

被引:19
作者
Rahman, Md. Arifur [1 ]
Lee, Young-Doo [1 ]
Koo, Insoo [1 ]
机构
[1] Univ Ulsan, Sch Elect Engn, 93 Daehak Ro, Ulsan 44610, South Korea
关键词
Cooperative communication; Cognitive radio networks; Transmission mode; Relay selection; Q-learning; RELAY SELECTION;
D O I
10.1186/s13673-016-0057-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Cooperative communication systems use cooperative relays for transmitting their data packets to the destination. Cooperative communication schemes having all relays participating in transmission may cause unnecessary wastes of most valuable spectrum resources. So it is mandatory to effectively select a transmission mode for cooperative cognitive radio networks (CCRNs). In this paper, an efficient transmission mode scheme based on Q-learning algorithm is proposed. State, action, and reward are defined to achieve a good performance on time delay and energy efficiency in data transmission as well as the interference to primary users during secondary users transmission. The proposed scheme selects an optimal action on the networks environment to maximize the total revenue of the multilateral metric. The simulation result shows that the proposed scheme can efficiently support the determination for the transmission mode and outperforms conventional schemes for a single metric in CCRNs.
引用
收藏
页数:14
相关论文
共 30 条
[1]  
[Anonymous], 2012, ENERGY
[2]   Power Consumption Analysis of Prominent Time Synchronization Protocols for Wireless Sensor Networks [J].
Bae, Shi-Kyu .
JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2014, 10 (02) :300-313
[3]   Stochastic Power Adaptation with Multiagent Reinforcement Learning for Cognitive Wireless Mesh Networks [J].
Chen, Xianfu ;
Zhao, Zhifeng ;
Zhang, Honggang .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2013, 12 (11) :2155-2166
[4]  
Chong J., 2013, J CONVERGENCE, V4, P7
[5]   Relay Selection for Two-Way Full Duplex Relay Networks With Amplify-and-Forward Protocol [J].
Cui, Hongyu ;
Ma, Meng ;
Song, Lingyang ;
Jiao, Bingli .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2014, 13 (07) :3768-3777
[6]  
El-Mahdy A, 2013, SIG P ALGO ARCH ARR, P274
[7]   On capacity under receive and spatial spectrum-sharing constraints [J].
Gastpar, Michael .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (02) :471-487
[8]   Breaking Spectrum Gridlock With Cognitive Radios: An Information Theoretic Perspective [J].
Goldsmith, Andrea ;
Jafar, Syed Ali ;
Maric, Ivana ;
Srinivasa, Sudhir .
PROCEEDINGS OF THE IEEE, 2009, 97 (05) :894-914
[9]   Cognitive radio: Brain-empowered wireless communications [J].
Haykin, S .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2005, 23 (02) :201-220
[10]   Joint Relay Selection and Opportunistic Source Selection in Bidirectional Cooperative Diversity Networks [J].
Ju, MinChul ;
Kim, Il-Min .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2010, 59 (06) :2885-2897