Performance-Aware Based Correlated Datasets Replication Strategy

被引:0
作者
Ye, Lin [1 ]
Luan, Zhongzhi [1 ]
Yang, Hailong [1 ]
机构
[1] Beihang Univ, Sinogerman Joint Software Inst, Beijing 100191, Peoples R China
来源
TRUSTWORTHY COMPUTING AND SERVICES (ISCTCS 2014) | 2015年 / 520卷
关键词
Correlated data; Performance-aware; Elastic replica management; AVAILABILITY;
D O I
10.1007/978-3-662-47401-3_42
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Performance-aware based correlated datasets replication strategy (PCDRS) has been put forward to solve the issue of how to place datasets at a wide area distributed environment to support researchers on interdisciplinary scientific research. The issue is addressed from three parts. First of all, we gave out the replica number based on the performance requirement of the datasets. Secondly, according to the performance of the datanode, we determined the location for placing the datasets replica. Thirdly, we distinguished data from hot and cold to control the number of replicas elastically. The strategy has been put into tests on a HDFS cluster. The result shows that our strategy is performance effective in maintaining the reliability of datasets and promoting the access performance of the cluster.
引用
收藏
页码:322 / 327
页数:6
相关论文
共 8 条
[1]  
Bhagwan R, 2003, LECT NOTES COMPUT SC, V2735, P256
[2]  
Cidon A., 2013, USENIX ANN TECHN C
[3]  
Lazowska E. D., 1984, Quantitative system performance: computer system analysis using queueing network models
[4]   Assignment of movies to heterogeneous video servers [J].
Leung, YW ;
Hou, RYT .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2005, 35 (05) :665-681
[5]  
Qingsong W., 2010, 2010 IEEE INT C CLUS
[6]  
Rodrigues R, 2005, LECT NOTES COMPUT SC, V3640, P226, DOI 10.1007/11558989_21
[7]  
Sammer E., 2013, HADOOP OPERATIONS
[8]  
Zhendong C., 2012, 2012 IEEE INT C CLUS