Heterogeneity-Aware Codes With Uncoded Repair for Distributed Storage Systems

被引:15
|
作者
Zhu, Bing [1 ]
Shum, Kenneth W. [2 ]
Li, Hui [3 ,4 ]
机构
[1] Peking Univ, Sch Elect & Comp Engn, Shenzhen 518055, Peoples R China
[2] Chinese Univ Hong Kong, Inst Network Coding, Shatin, Hong Kong, Peoples R China
[3] Peking Univ, Inst Big Data Technol, Shenzhen 518055, Peoples R China
[4] Peking Univ, Shenzhen Engn Lab Converged Networks Technol, Shenzhen 518055, Peoples R China
关键词
Distributed storage systems; regenerating codes; repair bandwidth; uncoded repair; combinatorial designs; EXACT-REGENERATING CODES;
D O I
10.1109/LCOMM.2015.2415495
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
In practical large-scale distributed storage systems, node failures are unavoidable. It is therefore desirable to quickly recreate the failed nodes in order to maintain the system integrity. In this letter, we consider a family of erasure codes that provide uncoded repair, where the failed node is regenerated by transfer of data without extra arithmetic operations. We introduce flexible fractional repetition (FFR) code, of which the coding scheme is a concatenation of an outer MDS code and an inner repetition code. Our proposed codes are applicable to the heterogeneous network environment where node storage capacities and packet repetition degrees vary in a wide range. We present explicit constructions of FFR codes by utilizing combinatorial designs. We further propose a heuristic code construction. Evaluation results show that FFR codes outperform regenerating codes in node repair efficiency.
引用
收藏
页码:901 / 904
页数:4
相关论文
共 50 条
  • [21] Locality-aware fountain codes for massive distributed storage systems
    Okpotse, Toritseju
    Yousefi, Shahram
    2015 IEEE 14TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2015, : 18 - 21
  • [22] hStorage-DB: Heterogeneity-aware Data Management to Exploit the Full Capability of Hybrid Storage Systems
    Luo, Tian
    Lee, Rubao
    Mesnier, Michael
    Chen, Feng
    Zhang, Xiaodong
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (10): : 1076 - 1087
  • [23] Z codes: General Systematic Erasure Codes with Optimal Repair Bandwidth and Storage for Distributed Storage Systems
    Liu, Qing
    Feng, Dan
    Jiang, Hong
    Hu, Yuchong
    Jiao, Tianfeng
    2015 IEEE 34TH SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2015, : 212 - 217
  • [24] Heterogeneity-aware Clustered Distributed Learning for Multi-source Data Analysis
    Chen, Yuanxing
    Zhang, Qingzhao
    Ma, Shuangge
    Fang, Kuangnan
    JOURNAL OF MACHINE LEARNING RESEARCH, 2024, 25
  • [25] Heterogeneity-aware fair federated learning
    Li, Xiaoli
    Zhao, Siran
    Chen, Chuan
    Zheng, Zibin
    INFORMATION SCIENCES, 2023, 619 : 968 - 986
  • [26] HALO: Heterogeneity-Aware Load Balancing
    Gandhi, Anshul
    Zhang, Xi
    Mittal, Naman
    2015 IEEE 23rd International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 2015), 2015, : 242 - 251
  • [27] New Codes and Inner Bounds for Exact Repair in Distributed Storage Systems
    Goparaju, Sreechakra
    El Rouayheb, Salim
    Calderbank, Robert
    2014 48TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2014,
  • [28] Exact-Repair Codes With Partial Collaboration in Distributed Storage Systems
    Liu, Shiqiu
    Shum, Kenneth W.
    Li, Congduan
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (07) : 4012 - 4021
  • [29] A Migratory Heterogeneity-Aware Data Layout Scheme for Parallel File Systems
    He, Shuibing
    Sun, Xian-He
    Wang, Yang
    Xu, Chengzhong
    2018 32ND IEEE INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2018, : 1133 - 1142
  • [30] New Codes and Inner Bounds for Exact Repair in Distributed Storage Systems
    Goparaju, Sreechakra
    El Rouayheb, Salim
    Calderbank, Robert
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 1036 - 1040