An adaptive learning scheme for load balancing with zone partition in multi-sink wireless sensor network

被引：32

作者：

Cheng, Sheng-Tzong ^{[1
]}

Chang, Tun-Yu ^{[1
]}

机构：

[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 70101, Taiwan

来源：

EXPERT SYSTEMS WITH APPLICATIONS | 2012年 / 39卷 / 10期

关键词：

Adaptive learning; Reinforcement learning problem; Load balancing; Multi-sink wireless sensor network; Q-learning based adaptive zone partition scheme;

D O I：

10.1016/j.eswa.2012.02.119

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In many researches on load balancing in multi-sink WSN, sensors usually choose the nearest sink as destination for sending data. However, in WSN, events often occur in specific area. If all sensors in this area all follow the nearest-sink strategy, sensors around nearest sink called hotspot will exhaust energy early. It means that this sink is isolated from network early and numbers of routing paths are broken. In this paper, we propose an adaptive learning scheme for load balancing scheme in multi-sink WSN. The agent in a centralized mobile anchor with directional antenna is introduced to adaptively partition the network into several zones according to the residual energy of hotspots around sink nodes. In addition, machine learning is applied to the mobile anchor to make it adaptable to any traffic pattern. Through interactions with the environment, the agent can discovery a near-optimal control policy for movement of mobile anchor. The policy can achieve minimization of residual energy's variance among sinks, which prevent the early isolation of sink and prolong the network lifetime. (C) 2012 Elsevier Ltd. All rights reserved.

引用

页码：9427 / 9434

页数：8

共 16 条

[1] LEARNING TO ACT USING REAL-TIME DYNAMIC-PROGRAMMING [J].

BARTO, AG ;

BRADTKE, SJ ;

SINGH, SP .

ARTIFICIAL INTELLIGENCE, 1995, 72 (1-2) :81-138

[2]

Bellman R. E., 1957, Dynamic programming. Princeton landmarks in mathematics

[3]

Forster A., 2007, P ISSNIP 07 MELB, P367

[4]

Fortune S., 1992, COMPUTING EUCLIDEAN, P193, DOI [DOI 10.1142/9789814355858, DOI 10.1142/9789814355858_0006]

[5] Reinforcement learning: A survey [J].

Kaelbling, LP ;

Littman, ML ;

Moore, AW .

JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 1996, 4 :237-285

[6] Self-organized data-gathering scheme for multi-sink sensor networks inspired by swarm intelligence [J].

Kiri, Yuichi ;

Sugano, Masashi ;

Murata, Masayuki .

FIRST IEEE INTERNATIONAL CONFERENCE ON SELF-ADAPTIVE AND SELF-ORGANIZING SYSTEMS, 2007, :161-+

[7]

Lee H., 2005, P IEEE INT C MOB ADH

[8] Energy efficient routing in multiple sink sensor networks [J].

Meng, Min ;

Wu, Xiaoling ;

Xu, Hui ;

Jeong, Byeong-Soo ;

Lee, Sungyoung ;

Lee, Young-Koo .

ICCSA 2007: PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND APPLICATIONS, 2007, :561-+

[9]

Puterman M.L., 2014, MARKOV DECISION PROC

[10]

Soyturk M, 2006, 2006 IEEE ANNUAL WIRELESS AND MICROWAVE TECHNOLOGY CONFERENCE, P243

← 1 2 →