Multi-Agent Reinforcement Learning Based Opportunistic Routing and Channel Assignment for Mobile Cognitive Radio Ad Hoc Network

被引：17

作者：

Barve, Sunita S. ^{[1
]}

Kulkarni, Parag ^{[2
]}

机构：

[1] Bharati Vidyapeeth Deemed Univ, Coll Engn, Pune, Maharashtra, India

[2] Anomaly Solut Pvt Ltd, Pune, Maharashtra, India

来源：

MOBILE NETWORKS & APPLICATIONS | 2014年 / 19卷 / 06期

关键词：

Cognitive radio network; Routing schemes; Multi-agent; Reinforcement learning; Spectrum management; Mobility model; ALLOCATION; PROTOCOL;

D O I：

10.1007/s11036-014-0551-6

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Opportunistic spectrum access using cognitive radio technology enables exploring vacant licensed spectrum bands and thereby improving the spectrum utilization. However, it will have a significant impact on upper layer performance like routing as the reliable knowledge of topology and channel statistics are not available, especially in Mobile Cognitive Radio Ad hoc Network (MCRAN). To address specific requirements of MCRAN, this paper is proposing online opportunistic routing algorithm using multi-agent reinforcement learning. The proposed routing scheme jointly addresses, link and relay selection based on transmission success probabilities. This sophisticated learning mechanism successfully explores opportunities in partially observable and non-stationary environment of MCRAN. Simulation results show the effectiveness of this algorithm.

引用

页码：720 / 730

页数：11

共 36 条

[1] Mobility assisted spectrum aware routing protocol for cognitive radio ad hoc networks [J].

Abedi, Omid ;

Berangi, Reza .

JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE C-COMPUTERS & ELECTRONICS, 2013, 14 (11) :873-886

[2] NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey [J].

Akyildiz, Ian F. ;

Lee, Won-Yeol ;

Vuran, Mehmet C. ;

Mohanty, Shantidev .

COMPUTER NETWORKS, 2006, 50 (13) :2127-2159

[3]

[Anonymous], 2009, 2009 4 INT C COGN RA, DOI DOI 10.1109/CROWNCOM.2009.5189189

[4]

Ariyakhajorn J., 2006, 2006 International Symposium on Communications and Information Technologies (IEEE Cat No. 06EX1447C), P894, DOI 10.1109/ISCIT.2006.339866

[5]

Badoi CI, 2010, PROCEEDINGS OF THE 2010 8TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS (COMM), P491, DOI 10.1109/ICCOMM.2010.5509020

[6] Adaptive Opportunistic Routing for Wireless Ad Hoc Networks [J].

Bhorkar, Abhijeet A. ;

Naghshvar, Mohammad ;

Javidi, Tara ;

Rao, Bhaskar D. .

IEEE-ACM TRANSACTIONS ON NETWORKING, 2012, 20 (01) :243-256

[7] Reactive routing for mobile cognitive radio ad hoc networks [J].

Cacciapuoti, Angela Sara ;

Caleffi, Marcello ;

Paura, Luigi .

AD HOC NETWORKS, 2012, 10 (05) :803-815

[8] Routing in cognitive radio networks: Challenges and solutions [J].

Cesana, Matteo ;

Cuomo, Francesca ;

Ekici, Eylem .

AD HOC NETWORKS, 2011, 9 (03) :228-248

[9] CRP: A Routing Protocol for Cognitive Radio Ad Hoc Networks [J].

Chowdhury, Kaushik R. ;

Akyildiz, Ian F. .

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2011, 29 (04) :794-804

[10]

Di Felice M, 2010, INT J PERFORM EVAL, V68, P859

← 1 2 3 4 →