Reducing Repair Traffic with Exact and Uncoded Repair in Distributed Storage Systems: Intersecting Zigzag Sets Codes on Hierarchical Codes

被引:0
作者
You, Pengfei [1 ]
Huang, Zhen [1 ]
Wang, Changjian [1 ]
Peng, Yuxing [1 ]
机构
[1] Natl Univ Def Technol, Coll Comp, Changsha, Hunan, Peoples R China
来源
2014 IEEE 17TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND ENGINEERING (CSE) | 2014年
关键词
distributed storage; network coding; regenerating code; IZS code; hierarchical code; repair traffic;
D O I
10.1109/CSE.2014.150
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Erasure code is an efficient redundancy solution to avoid permanent data losses in distributed storage system. By using erasure code, the original data is encoded into blocks which are stored on different nodes. When one node fails, the lost data block needs to be recovered by transmitting a large number of data from helper nodes, which is called repair. Intersecting zigzag sets codes (IZS codes) and hierarchical code are two kinds of codes which reduce the bandwidth overhead in repair. IZS codes reduce the amount of data uploaded by each helper node, while hierarchical codes reduce the number of nodes participating in repair. In this paper, we propose a class of code called intersecting zigzag sets-hierarchical code (IZ2SHC code) to unify them together. IZ2SHC code decreases repair degree as hierarchical code and reduces repair overhead compared with the latter. Besides, it realizes exact regeneration of the failed data, and need not encode in helper node during the repair, which reduces disk read cost for helper node when transferring data in repair.
引用
收藏
页码:722 / 728
页数:7
相关论文
共 15 条
[1]   Network information flow [J].
Ahlswede, R ;
Cai, N ;
Li, SYR ;
Yeung, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2000, 46 (04) :1204-1216
[2]   Asymptotic Interference Alignment for Optimal Repair of MDS Codes in Distributed Storage [J].
Cadambe, Viveck R. ;
Jafar, Syed Ali ;
Maleki, Hamed ;
Ramchandran, Kannan ;
Suh, Changho .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2013, 59 (05) :2974-2987
[3]   Network coding for distributed storage systems [J].
Dimakis, Alexandros G. ;
Godfrey, P. Brighten ;
Wainwright, Martin J. ;
Ramchandran, Kannan .
INFOCOM 2007, VOLS 1-5, 2007, :2000-+
[4]   Hierarchical Codes: How to Make Erasure Codes Attractive for Peer-to-Peer Storage Systems [J].
Duminuco, Alessandro ;
Biersack, Ernst .
P2P'08: EIGHTH INTERNATIONAL CONFERENCE ON PEER-TO-PEER COMPUTING, PROCEEDINGS, 2008, :89-98
[5]   Hierarchical codes: A flexible trade-off for erasure codes in peer-to-peer storage systems [J].
Duminuco, Alessandro ;
Biersack, Ernst W. .
PEER-TO-PEER NETWORKING AND APPLICATIONS, 2010, 3 (01) :52-66
[6]  
Ghemawat S., 1955, ACM S OP SYST PRINC, P29
[7]  
Hao Jie, 2013, Journal of Electronics (China), V30, P290, DOI 10.1007/s11767-013-3019-0
[8]  
Hu Y., 2013, IEEE INT C COMP COMM
[9]  
Kubiatowicz J, 2000, ACM SIGPLAN NOTICES, V35, P190, DOI 10.1145/384264.379239
[10]  
Papailiopoulos DS, 2011, IEEE INT SYMP INFO, P1230, DOI 10.1109/ISIT.2011.6033731