On the Sub-Packetization Size and the Repair Bandwidth of Reed-Solomon Codes

被引:20
作者
Li, Weiqi [1 ]
Wang, Zhiying [1 ]
Jafarkhani, Hamid [1 ]
机构
[1] Univ Calif Irvine, Ctr Pervas Commun & Comp, Irvine, CA 92697 USA
关键词
Network coding; distributed storage; Reed-Solomon (RS) codes; repair bandwidth; sub-packetization size; DISTRIBUTED STORAGE; REGENERATING CODES; ERASURE CODES; MDS CODES;
D O I
10.1109/TIT.2019.2917425
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Reed-Solomon (RS) codes are widely used in distributed storage systems. In this paper, we study the repair bandwidth and sub-packetization size of RS codes. The repair bandwidth is defined as the amount of transmitted information from surviving nodes to a failed node. The RS code can be viewed as a polynomial over a finite field GF(q(l)) evaluated at a set of points, where l is called the sub-packetization size. Smaller bandwidth reduces the network traffic in distributed storage, and smaller l facilitates the implementation of RS codes with lower complexity. Recently, Guruswami and Wootters proposed a repair method for RS codes when the evaluation points are the entire finite field. While the sub-packetization size can be arbitrarily small, the repair bandwidth is higher than the minimum storage regenerating (MSR) bound. Tamo, Ye, and Barg achieved the MSR bound but the sub-packetization size grows faster than the exponential function of the number of the evaluation points. In this paper, we present code constructions and repair schemes that extend these results to accommodate different sizes of the evaluation points. In other words, we design schemes that provide points in between. These schemes provide a flexible tradeoff between the sub-packetization size and the repair bandwidth. In addition, we generalize our schemes to manage multiple failures.
引用
收藏
页码:5484 / 5502
页数:19
相关论文
共 36 条
[11]   Network Coding for Distributed Storage Systems [J].
Dimakis, Alexandros G. ;
Godfrey, P. Brighten ;
Wu, Yunnan ;
Wainwright, Martin J. ;
Ramchandran, Kannan .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (09) :4539-4551
[12]  
Gashkov S.B., 2013, J MATH SCI, V191, P661, DOI DOI 10.1007/S10958-013-1350-5
[13]   Minimum Storage Regenerating Codes for All Parameters [J].
Goparaju, Sreechakra ;
Fazeli, Arman ;
Vardy, Alexander .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (10) :6318-6328
[14]   Improved decoding of Reed-Solomon and algebraic-geometric codes [J].
Guruswami, V ;
Sudan, M .
39TH ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 1998, :28-37
[15]  
Guruswami V, 2017, PROCEEDINGS OF THE TWENTY-EIGHTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P2109
[16]   Repairing Reed-Solomon Codes [J].
Guruswami, Venkatesan ;
Wootters, Mary .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (09) :5684-5698
[17]  
Dau H, 2017, IEEE INT SYMP INFO, P346, DOI 10.1109/ISIT.2017.8006547
[18]  
Khan O., 2012, FAST
[19]   HashTag Erasure Codes: From Theory to Practice [J].
Kralevska, Katina ;
Gligoroski, Danilo ;
Jensen, Rune E. ;
Overby, Harald .
IEEE TRANSACTIONS ON BIG DATA, 2018, 4 (04) :516-529
[20]  
Li WQ, 2017, ANN ALLERTON CONF, P942, DOI 10.1109/ALLERTON.2017.8262839