Design of Opportunistic Routing Based on Markov Decision Process

被引：0

作者：

Hao, Jun ^{[1
]}

Jia, Xinchun ^{[1
]}

Han, Zongyuan ^{[2
]}

Yang, Bo ^{[1
]}

Peng, Dengyong ^{[1
]}

机构：

[1] Shanxi Univ, Sch Math Sci, Taiyuan 030006, Shanxi, Peoples R China

[2] China Acad Railway Sci, Inst Comp Technol, Beijing 100081, Peoples R China

来源：

PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017) | 2017年

关键词：

Opportunistic Routing; Markov Decision Process; Optimal Forwarding Strategy; NETWORKS;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The instability of wireless links makes the choice of forwarding nodes have too many possibilities in opportunistic routing. In this paper, the Markov decision process (MDP) is used to model the whole packet forwarding process from the source node to the destination node, which facilitates making reasonable decisions when the sender selects the forwarding nodes. By solving a finite-state MDP problem, an optimal forwarding strategy is obtained to minimize the expected number of transmissions for each node. Further more, the properties of expected any-path transmissions (EAX) are used for the selection of candidate forwarder set, which can significantly reduce the feasible optimal solution space. Finally, An opportunistic routing protocol based on Markov decision process (MDP-OR) is designed, whose effectiveness is verified by an example and its simulation.

引用

页码：8976 / 8981

页数：6

共 50 条

[31] A Markov Decision Process-based handicap system for tennis [J].

Chan, Timothy C. Y. ;

Singal, Raghav .

JOURNAL OF QUANTITATIVE ANALYSIS IN SPORTS, 2016, 12 (04) :179-189

[32] Optimal Replacement Policy of Services Based on Markov Decision Process [J].

Pillai, Sandhya S. ;

Narendra, Nanjangud C. .

2009 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING, 2009, :176-+

[33] An Opportunistic Routing Based on Directional Transmission in the Internet of Underwater Things [J].

Jiang, Jinfang ;

Yan, Qian ;

Han, Guangjie ;

Wang, Hao .

IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (18) :16392-16403

[34] Assessment Model for Opportunistic Routing [J].

Moreira, W. ;

Mendes, P. ;

Sargento, S. .

IEEE LATIN AMERICA TRANSACTIONS, 2012, 10 (03) :1785-1790

[35] Markov Decision Process for imbalanced classification [J].

Xuan, Chunyu ;

Yang, Jing ;

Jiang, Zhou ;

Zhang, Dong .

2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, :27-32

[36] Markov Decision Process Based Content Dissemination in Hybrid Wireless Networks [J].

Wang, Fang ;

Li, Yong ;

Wang, Zhaocheng ;

Yang, Zhixing .

2012 8TH INTERNATIONAL WIRELESS COMMUNICATIONS AND MOBILE COMPUTING CONFERENCE (IWCMC), 2012, :889-894

[37] Activity Support Framework for People with Dementia Based on Markov Decision Process [J].

Sarni, Tomi ;

Pulli, Petri .

2015 INTERNATIONAL CONFERENCE ON INTELLIGENT ENVIRONMENTS IE 2015, 2015, :25-32

[38] A Markov Decision Process-based Collision Avoidance in IoT Applications [J].

Djiroun, Fatima Zahra ;

Bagaa, Miloud ;

Taleb, Tarik .

GLOBECOM 2017 - 2017 IEEE GLOBAL COMMUNICATIONS CONFERENCE, 2017,

[39] Free gait planning for a hexapod robot based on Markov decision process [J].

Li, Manhong ;

Zhang, Jianhua ;

Zhang, Xiaojun ;

Zhang, Minglu .

Jiqiren/Robot, 2015, 37 (05) :529-537

[40] Edge cloud service migration algorithm based on Markov decision process [J].

Ma A. ;

Pan S. .

Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (06) :1931-1939

← 1 2 3 4 5 →