MDS Code Constructions With Small Sub-Packetization and Near-Optimal Repair Bandwidth

被引:38
作者
Rawat, Ankit Singh [1 ]
Tamo, Itzhak [2 ]
Guruswami, Venkatesan [3 ]
Efremenko, Klim [4 ]
机构
[1] MIT, Res Lab Elect, Cambridge, MA 02139 USA
[2] Tel Aviv Univ, Dept Elect Engn Syst, IL-69978 Ramat Aviv, Israel
[3] Carnegie Mellon Univ, Comp Sci Dept, Pittsburgh, PA 15213 USA
[4] Ben Gurion Univ Negev, Dept Comp Sci, IL-84105 Beer Sheva, Israel
关键词
Codes for distributed storage; regenerating codes; sub-packetization level; repair bandwidth; cut-set bound; DISTRIBUTED STORAGE;
D O I
10.1109/TIT.2018.2810095
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper addresses the problem of constructing maximum distance separable (MDS) codes that enable exact reconstruction (repair) of each code block by downloading a small amount of information from the remaining code blocks. The total amount of information flow from the remaining code blocks during this reconstruction process is referred to as repair bandwidth of the underlying code. Existing constructions of exact-repairable MDS codes with optimal repair bandwidth require working with large subpacketization levels, which restrict their applicability in practice. This paper presents two general approaches to construct exact-repairable MDS codes that aim at significantly reducing the required subpacketization level at the cost of slightly suboptimal repair bandwidth. The first approach provides MDS codes that have repair bandwidth at most twice the optimal repair bandwidth. In addition, these codes also have the smallest possible subpacketization level O(r), where r denotes the number of parity blocks. This approach is then generalized to design codes that have their repair bandwidth approaching the optimal repair bandwidth at the cost of graceful increment in the required subpacketization level. The second approach transforms an MDS code with optimal repair bandwidth and large subpacketization level into a longer MDS code with small subpacketization level and near-optimal repair bandwidth. For a given r, the codes constructed using this approach have their subpacketization level scaling logarithmically with the code length. In addition, the obtained codes require field size only linear in the code length and ensure load balancing among the intact code blocks in terms of the information downloaded from these blocks during the exact reconstruction of a code block.
引用
收藏
页码:6506 / 6525
页数:20
相关论文
共 41 条
[31]   Lower Bounds on the Sub-Packetization Level of MSR Codes and Characterizing Optimal-Access MSR Codes Achieving the Bound [J].
Balaji, S. B. ;
Vajha, Myna ;
Kumar, P. Vijay .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (10) :6452-6471
[32]   On sub-packetization and access number of capacity-achieving PIR schemes for MDS coded non-colluding servers [J].
Jingke XU ;
Zhifang ZHANG .
Science China(Information Sciences), 2018, 61 (10) :114-129
[33]   On sub-packetization and access number of capacity-achieving PIR schemes for MDS coded non-colluding servers [J].
Jingke Xu ;
Zhifang Zhang .
Science China Information Sciences, 2018, 61
[34]   Cooperative Repair: Constructions of Optimal MDS Codes for All Admissible Parameters [J].
Ye, Min ;
Barg, Alexander .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (03) :1639-1656
[35]   A Generic Transformation for Optimal Repair Bandwidth and Rebuilding Access in MDS Codes [J].
Li, Jie ;
Tang, Xiaohu ;
Tian, Chao .
2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017, :1623-1627
[36]   A Low-Complexity Shorten Regenerating Code with Optimal Repair Bandwidth [J].
Li, Ke ;
Gu, Shushi ;
Wang, Ye ;
Jiao, Jian ;
Zhang, Qinyu .
COMMUNICATIONS, SIGNAL PROCESSING, AND SYSTEMS, CSPS 2018, VOL II: SIGNAL PROCESSING, 2020, 516 :361-369
[37]   An Explicit, Coupled-Layer Construction of a High-Rate MSR Code with Low Sub-Packetization Level, Small Field Size and d < (n-1) [J].
Sasidharan, Birenjith ;
Vajha, Myna ;
Kumar, P. Vijay .
2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017, :2048-2052
[38]   Several Constructions of Near MDS Codes and Optimal Locally Recoverable Codes [J].
Wang X.-R. ;
Heng Z.-L. .
Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (03) :957-966
[39]   Bandwidth Cost of Code Conversions in Distributed Storage: Fundamental Limits and Optimal Constructions [J].
Maturana, Francisco ;
Rashmi, K. V. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2023, 69 (08) :4993-5008
[40]   An Alternative Generic Transformation for Optimal Repair Bandwidth and Rebuilding Access in MDS Codes [J].
Li, Jie ;
Tang, Xiaohu ;
Tian, Chao .
2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, :1894-1898