Design of Opportunistic Routing Based on Markov Decision Process

被引：0

作者：

Hao, Jun ^{[1
]}

Jia, Xinchun ^{[1
]}

Han, Zongyuan ^{[2
]}

Yang, Bo ^{[1
]}

Peng, Dengyong ^{[1
]}

机构：

[1] Shanxi Univ, Sch Math Sci, Taiyuan 030006, Shanxi, Peoples R China

[2] China Acad Railway Sci, Inst Comp Technol, Beijing 100081, Peoples R China

来源：

PROCEEDINGS OF THE 36TH CHINESE CONTROL CONFERENCE (CCC 2017) | 2017年

关键词：

Opportunistic Routing; Markov Decision Process; Optimal Forwarding Strategy; NETWORKS;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The instability of wireless links makes the choice of forwarding nodes have too many possibilities in opportunistic routing. In this paper, the Markov decision process (MDP) is used to model the whole packet forwarding process from the source node to the destination node, which facilitates making reasonable decisions when the sender selects the forwarding nodes. By solving a finite-state MDP problem, an optimal forwarding strategy is obtained to minimize the expected number of transmissions for each node. Further more, the properties of expected any-path transmissions (EAX) are used for the selection of candidate forwarder set, which can significantly reduce the feasible optimal solution space. Finally, An opportunistic routing protocol based on Markov decision process (MDP-OR) is designed, whose effectiveness is verified by an example and its simulation.

引用

页码：8976 / 8981

页数：6

共 50 条

[21] Strategic Decision for Crowd-Sensing: An Approach based on Markov Decision Process
Ray, Arpita
Chowdhury, Chandreyee
Roy, Sarbani
[J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ADVANCED NETWORKS AND TELECOMMUNICATIONS SYSTEMS (ANTS), 2017,
[22] Forecasting design and decision paths in ship design using the ship-centric Markov decision process model
Kana, Austin A.
[J]. OCEAN ENGINEERING, 2017, 137 : 328 - 337
[23] A Markov Model for Batch-Based Opportunistic Routing in Multi-Hop Wireless Mesh Networks
Zhang, Chen
Li, Cheng
Chen, Yuanzhu
[J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (12) : 12025 - 12037
[24] Quality Control for Express Items Based on Markov Decision Process
Han, Xu
Li, Yisong
[J]. 2016 INTERNATIONAL CONFERENCE ON LOGISTICS, INFORMATICS AND SERVICE SCIENCES (LISS' 2016), 2016,
[25] Customer lifetime value management based on markov decision process
Tian, ZX
He, Y
[J]. ICIM' 2004: PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON INDUSTRIAL MANAGEMENT, 2004, : 549 - 554
[26] Planning for Target System Striking Based on Markov Decision Process
Lei Ting
Zhu Cheng
Zhang Weiming
[J]. 2013 IEEE INTERNATIONAL CONFERENCE ON SERVICE OPERATIONS AND LOGISTICS, AND INFORMATICS (SOLI), 2013, : 154 - 159
[27] A Markov Decision Process-based handicap system for tennis
Chan, Timothy C. Y.
Singal, Raghav
[J]. JOURNAL OF QUANTITATIVE ANALYSIS IN SPORTS, 2016, 12 (04) : 179 - 189
[28] A Markov Decision Process-based Optimal Vehicle Scheduling Model for Supply Chains
Zhao, Zhenjun
Alqahtani, Fayez
Almakhadmeh, Zafer
[J]. JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2025,
[29] Optimal Replacement Policy of Services Based on Markov Decision Process
Pillai, Sandhya S.
Narendra, Nanjangud C.
[J]. 2009 IEEE INTERNATIONAL CONFERENCE ON SERVICES COMPUTING, 2009, : 176 - +
[30] An Opportunistic Routing Based on Directional Transmission in the Internet of Underwater Things
Jiang, Jinfang
Yan, Qian
Han, Guangjie
Wang, Hao
[J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (18) : 16392 - 16403

← 1 2 3 4 5 →