General Functional Regenerating Codes with Uncoded Repair for Distributed Storage System

被引:3
作者
Liu, Qing [1 ]
Feng, Dan [1 ]
Shi, Zhan [1 ]
Fu, Min [1 ]
机构
[1] HUST, Sch Comp, Wuhan Natl Lab Optoelect, Wuhan, Peoples R China
来源
2015 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING | 2015年
关键词
Regenerating codes; Storage system; Uncoded repair; Repair bandwidth; Performance and evaluation;
D O I
10.1109/CCGrid.2015.38
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Erasure codes are widely used in modern distributed storage systems to prevent data loss and server failures. Regenerating codes are a class of erasure codes that trades storage efficiency and computation for repair bandwidth reduction. However, their non-unified coding parameters and huge computation overhead prohibit their applications. Hence, we first propose a family of Functional Regenerating Codes (FRCs) with uncoded repair, balancing storage efficiency and repair bandwidth with general parameters. FRCs take advantage of a heuristic repair algorithm, which makes efforts to employ as little repair bandwidth as possible. Second, we optimize encoding by constructing the generator matrix with a bitmatrix, so encoding of FRCs can be executed by fast bitwise XORs. Further, we also optimize repairing with the Scheduled Shift Multiplication (SSM) algorithm, which accelerates the matrix product over the Galois field during repair. Compared to the traditional table-lookup multiplication algorithm, our SSM algorithm gains 1.2 similar to 2X speed-up.
引用
收藏
页码:372 / 381
页数:10
相关论文
共 23 条
  • [1] [Anonymous], FAST 2013
  • [2] Anvin HPeter., 2007, The mathematics of RAID-6
  • [3] NCCloud: A Network-Coding-Based Storage System in a Cloud-of-Clouds
    Chen, Henry C. H.
    Hu, Yuchong
    Lee, Patrick P. C.
    Tang, Yang
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2014, 63 (01) : 31 - 44
  • [4] Cullina Daniel, 2009, ARXIV09102245
  • [5] Dickson L.E., 2003, Linear Groups: With an Exposition of the Galois Field Theory
  • [6] A Survey on Network Codes for Distributed Storage
    Dimakis, Alexandros G.
    Ramchandran, Kannan
    Wu, Yunnan
    Suh, Changho
    [J]. PROCEEDINGS OF THE IEEE, 2011, 99 (03) : 476 - 489
  • [7] Network Coding for Distributed Storage Systems
    Dimakis, Alexandros G.
    Godfrey, P. Brighten
    Wu, Yunnan
    Wainwright, Martin J.
    Ramchandran, Kannan
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (09) : 4539 - 4551
  • [8] Hu Y., 2012, USENIX FAST
  • [9] Hu YF, 2011, 2011 AASRI CONFERENCE ON APPLIED INFORMATION TECHNOLOGY (AASRI-AIT 2011), VOL 1, P1
  • [10] Huang C., 2012, USENIX ANN TECHN C U