Repairing Multiple Data Losses by Parallel Max-min Trees Based on Regenerating Codes in Distributed Storage Systems

被引:0
作者
You, Pengfei [1 ]
Peng, Yuxing [1 ]
Huang, Zhen [1 ]
Wang, Changjian [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha 410073, Hunan, Peoples R China
来源
ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2014, PT II | 2014年 / 8631卷
关键词
Distributed storage System; Data regeneration; Regenerating codes; Regeneration tree; Max-min tree; Maximum spanning tree;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Due to high storage efficiency, erasure codes are recently used to provide high data reliability in distributed storage systems. When multiple data loses in system, regeneration time for them demands to be as short as possible so as to keep data availbility and reliability. Common way is to repair them one by one, which prolongs the regeneration time. Tree-structured regeneration may reduce regeneration time when regenerating one single node failure by relaying the network traffic, and is also extended to regenerate multiple data losses. In this paper, based on regenerating codes which achieve minimal network traffic during the regeneration, we consider reducing regeneration time by using multiple max-min trees to parallel regenerate multiple data losses. And we proposed an algorithm: bandwidth-sharing max-min algorithm (BSM2RC) to construct multiple parallel max-min trees. It realizes efficient bandwidth utilization by maximizing the minimal bottleneck edge weight of multiple regeneration trees, thus improve regeneration efficiency. Our simulation experiment shows that multiple parallel max-min trees reduce total regeneration time for multiple data losses significantly, and thus enhance system reliability, compared with existing regeneration scheme.
引用
收藏
页码:325 / 338
页数:14
相关论文
共 16 条
  • [1] [Anonymous], P 1 WORKSH NETW COD
  • [2] [Anonymous], 2003, SOSP
  • [3] [Anonymous], 2007, ALL C CONTR COMP COM
  • [4] Bhagwan R., 2004, P NSDI 2001 MARCH
  • [5] MIN-MAX SPANNING TREE PROBLEM AND SOME EXTENSIONS
    CAMERINI, PM
    [J]. INFORMATION PROCESSING LETTERS, 1978, 7 (01) : 10 - 14
  • [6] Network coding for distributed storage systems
    Dimakis, Alexandros G.
    Godfrey, P. Brighten
    Wainwright, Martin J.
    Ramchandran, Kannan
    [J]. INFOCOM 2007, VOLS 1-5, 2007, : 2000 - +
  • [7] Cooperative Recovery of Distributed Storage Systems from Multiple Losses with Network Coding
    Hu, Yuchong
    Xu, Yinlong
    Wang, Xiaozhao
    Zhan, Cheng
    Li, Pei
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2010, 28 (02) : 268 - 276
  • [8] Huang C., 2012, PROC 2012 USENIX C A
  • [9] Lee SJ, 2005, LECT NOTES COMPUT SC, V3431, P292
  • [10] LI J, 2009, P 17 IEEE INT WORKSH