A Replica Management Strategy Based On MOEA/D

被引:0
作者
Yang, Wanhao [1 ]
Hu, Yan [1 ]
机构
[1] Wuhan Univ Technol, Comp Sci & Technol, Wuhan, Hubei, Peoples R China
来源
PROCEEDINGS OF THE 2018 13TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2018) | 2018年
关键词
HDFS; MOEA/D; cloud storage; energy consuming; replication management;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As distributed storage systems have been used more and more widely nowadays, data replication management has become a hot research topic. Although replica technology can increase data availability and improve load balancing, an unreasonable replica management strategy will waste too much storage and increase the energy consuming sharply. In this paper, we developed a replica management strategy based on MOEA/D, in which we take five factors affecting replication decisions into consideration such as system data unavailability, network traffic, disk performance, load balancing and energy consuming. By using the improved MOEA/D algorithm, we get a Pareto solution sets, then an elite selection strategy based on individual density was proposed to pick out the suitable solution from the set. At last, we adjust the replica dynamically depending on the file access record log. Those steps are gathered to form the final strategy: A Replica Management Strategy Based On MOEA/D(MDRMS). Series of experiments are designed to demonstrate the validity and universality of the strategy. The experimental results show that MDRMS performs better than HDFS(Hadoop Distributed File System) and DRPMO (Dynamic Replica Placement based on Multi-objective Optimization), especially in load balancing and energy consuming.
引用
收藏
页码:2154 / 2159
页数:6
相关论文
共 14 条
[1]   DARE: Adaptive Data Replication for Efficient Cluster Scheduling [J].
Abad, Cristina L. ;
Lu, Yi ;
Campbell, Roy H. .
2011 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER), 2011, :159-168
[2]  
[Anonymous], 2003, P 19 ACM S OP SYST P, DOI [10.1145/1165389.945450, DOI 10.1145/1165389.945450]
[3]   Adaptive Replication Management in HDFS Based on Supervised Learning [J].
Bui, Dinh-Mao ;
Hussain, Shujaat ;
Huh, Eui-Nam ;
Lee, Sungyoung .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (06) :1369-1382
[4]   Dynamic hybrid replication effectively combining tree and grid topology [J].
Choi, Sung Chune ;
Youn, Hee Yong .
JOURNAL OF SUPERCOMPUTING, 2012, 59 (03) :1289-1311
[5]   MORM: A Multi-objective Optimized Replication Management strategy for cloud storage cluster [J].
Long, Sai-Qin ;
Zhao, Yue-Long ;
Chen, Wei .
JOURNAL OF SYSTEMS ARCHITECTURE, 2014, 60 (02) :234-244
[6]   A dynamic replica management strategy in data grid [J].
Mansouri, Najme ;
Dastghaibyfard, Gholam Hosein .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2012, 35 (04) :1297-1303
[7]  
Qingsong Wei, 2010, Proceedings of the 2010 IEEE International Conference on Cluster Computing (CLUSTER 2010), P188, DOI 10.1109/CLUSTER.2010.24
[8]  
Scpahvand R, 2011, J APPL SCI RES, V20117, P1485
[9]  
Shetty M, 2017, INT C COMP AN SEC TR
[10]  
Sivasubramanian S, 2017, DYNAMIC DATA SET REP