Erasure coding for distributed storage: an overview

被引:0
作者
S. B. Balaji
M. Nikhil Krishnan
Myna Vajha
Vinayak Ramkumar
Birenjith Sasidharan
P. Vijay Kumar
机构
[1] Indian Institute of Science,Department of Electrical Communication Engineering
[2] University of Southern California,Ming Hsieh Department of Electrical Engineering
来源
Science China Information Sciences | 2018年 / 61卷
关键词
distributed storage; regenerating codes; locally recoverable codes; codes with locality; erasure codes; node repair;
D O I
暂无
中图分类号
学科分类号
摘要
In a distributed storage system, code symbols are dispersed across space in nodes or storage units as opposed to time. In settings such as that of a large data center, an important consideration is the efficient repair of a failed node. Efficient repair calls for erasure codes that in the face of node failure, are efficient in terms of minimizing the amount of repair data transferred over the network, the amount of data accessed at a helper node as well as the number of helper nodes contacted. Coding theory has evolved to handle these challenges by introducing two new classes of erasure codes, namely regenerating codes and locally recoverable codes as well as by coming up with novel ways to repair the ubiquitous Reed-Solomon code. This survey provides an overview of the efforts in this direction that have taken place over the past decade.
引用
收藏
相关论文
共 189 条
  • [1] Sathiamoorthy M(2013)XORing elephants Proc VLDB Endow 6 325-336
  • [2] Asteris M(2011)A survey on network codes for distributed storage Proc IEEE 99 476-489
  • [3] Papailiopoulos D(2013)An overview of codes tailor-made for better repairability in networked distributed storage systems SIGACT News 44 89-272
  • [4] Dimakis G(2013)Erasure coding for cloud storage systems: a survey Tinshhua Sci Technol 18 259-4551
  • [5] Ramchandran K(2010)Network coding for distributed storage systems IEEE Trans Inf Theory 56 4539-288
  • [6] Wu Y N(2010)Existence and construction of capacity-achieving network codes for distributed storage IEEE J Sel Areas Commun 28 277-2158
  • [7] Datta A(2012)Interference alignment in regenerating codes for distributed storage: necessity and code constructions IEEE Trans Inf Theory 58 2134-967
  • [8] Oggier F(2013)On minimizing data-read and download for storage-node recovery IEEE Commun Lett 17 964-5239
  • [9] Li J(2011)Optimal exact-regenerating codes for distributed storage at the MSR and MBR points via a product-matrix construction IEEE Trans Inf Theory 57 5227-3241
  • [10] Li B(2014)Novel repair-by-transfer codes and systematic exact-mbr codes with lower complexities and smaller field sizes IEEE Trans Parallel Distrib Syst 25 3232-1938