Erasure coding for distributed storage: an overview

被引:119
作者
Balaji, S. B. [1 ]
Krishnan, M. Nikhil [1 ]
Vajha, Myna [1 ]
Ramkumar, Vinayak [1 ]
Sasidharan, Birenjith [1 ]
Kumar, P. Vijay [1 ,2 ]
机构
[1] Indian Inst Sci, Dept Elect Commun Engn, Bangalore 560012, Karnataka, India
[2] Univ Southern Calif, Ming Hsieh Dept Elect Engn, Los Angeles, CA 90089 USA
基金
美国国家科学基金会;
关键词
distributed storage; regenerating codes; locally recoverable codes; codes with locality; erasure codes; node repair; REGENERATING CODES; RECOVERABLE CODES; REPAIR; CONSTRUCTIONS; SYSTEMS; FRAMEWORK; BANDWIDTH; LOCALITY; WEIGHTS; BINARY;
D O I
10.1007/s11432-018-9482-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In a distributed storage system, code symbols are dispersed across space in nodes or storage units as opposed to time. In settings such as that of a large data center, an important consideration is the efficient repair of a failed node. Efficient repair calls for erasure codes that in the face of node failure, are efficient in terms of minimizing the amount of repair data transferred over the network, the amount of data accessed at a helper node as well as the number of helper nodes contacted. Coding theory has evolved to handle these challenges by introducing two new classes of erasure codes, namely regenerating codes and locally recoverable codes as well as by coming up with novel ways to repair the ubiquitous Reed-Solomon code. This survey provides an overview of the efforts in this direction that have taken place over the past decade.
引用
收藏
页数:45
相关论文
共 186 条
[1]   Combinatorial Alphabet-Dependent Bounds for Locally Recoverable Codes [J].
Agarwal, Abhishek ;
Barg, Alexander ;
Hu, Sihuang ;
Mazumdar, Arya ;
Tamo, Itzhak .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2018, 64 (05) :3481-3492
[2]  
Agarwal K, 2015, P 21 NAT C COMM MUMB
[3]  
Ahmad I, 2015, IEEE INT SYMP INFO, P849, DOI 10.1109/ISIT.2015.7282575
[4]   Combinatorial Nullstellensatz [J].
Alon, N .
COMBINATORICS PROBABILITY & COMPUTING, 1999, 8 (1-2) :7-29
[5]  
[Anonymous], LIQUID CLOUD STORAGE
[6]  
[Anonymous], REPAIRING REED SOLOM
[7]  
[Anonymous], BOUNDS CONSTRUCTIONS
[8]  
[Anonymous], 2013, CONSTRUCTION PMDS SD
[9]  
[Anonymous], 2016, IJICOT
[10]  
[Anonymous], 2016, INFORM THEORY INEQUA