An MDS Code Construction for Optimal Update and Efficient Repair With Linear Subpacketization Level and Small Field Size

被引:0
作者
Zeng, Yuan [1 ]
Lyu, Min [1 ,2 ]
Xu, Liangliang [3 ]
Li, Zhipeng [4 ]
Xu, Yinlong [1 ,2 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Peoples R China
[2] Anhui Prov Key Lab High Performance Comp, Hefei 230026, Peoples R China
[3] Xidian Univ, Inst Math & Interdisciplinary Sci, Xian 710071, Peoples R China
[4] Minjiang Univ, Sch Comp & Big Data, Fuzhou 350108, Peoples R China
基金
中国博士后科学基金;
关键词
Distributed storage; finite field size; maximum distance separable (MDS) codes; optimal update; repair bandwidth; subpacketization level; SMALL SUB-PACKETIZATION; DISTRIBUTED STORAGE; MSR;
D O I
10.1109/TR.2025.3559109
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Maximum Distance Separable (MDS) codes can provide the optimal storage efficiency with the same fault tolerance. From the practical considerations, the systematic and optimal update properties of codes are crucial, where the former affects the workflow of read/write operations while the latter impacts the write amplification costs in update intensive scenarios. Moreover, the repair bandwidth, subpacketization level, and finite field size are three important performance metrics to evaluate the effectiveness of codes, which impact the network traffic, I/O performance and computational complexity, respectively. However, various code constructions with the optimal update property were devised to minimize repair bandwidth with high subpacketization levels or huge finite field sizes. While other constructions that reach a good trade-off among these three performance metrics always lack the optimal update property. In this paper, to address the above challenges of constructing practical MDS codes, we present Permutation Transformation(PT) codes that excel in the following respects: The systematic and optimal update properties can be both guaranteed; the code reaches nearly optimal repair bandwidth when repairing any single systematic node; the subpacketization level achieves a linear scale of the fault-tolerance capacity; the required size of the finite field to ensure the MDS property is small.
引用
收藏
页数:12
相关论文
共 55 条
[1]   Combinatorial Nullstellensatz [J].
Alon, N .
COMBINATORICS PROBABILITY & COMPUTING, 1999, 8 (1-2) :7-29
[2]  
[Anonymous], 2020, HDFS erasure coding
[3]  
[Anonymous], 2016, Ceph erasure coding
[4]   Exact Construction of BS-Assisted MSCR Codes With Link Constraints [J].
Arslan, Suayb S. .
IEEE COMMUNICATIONS LETTERS, 2022, 26 (02) :225-228
[5]   Founsure 1.0: An erasure code library with efficient repair and update features [J].
Arslan, Suayb S. .
SOFTWAREX, 2021, 13
[6]  
Asteris M., 2012, Proceedings of the 2012 IEEE International Symposium on Information Theory - ISIT, P1752, DOI 10.1109/ISIT.2012.6283579
[7]   Coupling Decentralized Key-Value Stores with Erasure Coding [J].
Cheng, Liangfeng ;
Hu, Yuchong ;
Lee, Patrick P. C. .
PROCEEDINGS OF THE 2019 TENTH ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '19), 2019, :377-389
[8]   Network Coding for Distributed Storage Systems [J].
Dimakis, Alexandros G. ;
Godfrey, P. Brighten ;
Wu, Yunnan ;
Wainwright, Martin J. ;
Ramchandran, Kannan .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (09) :4539-4551
[9]   LOW-DENSITY PARITY-CHECK CODES [J].
GALLAGER, RG .
IRE TRANSACTIONS ON INFORMATION THEORY, 1962, 8 (01) :21-&
[10]  
Ghemawat S., 2003, Operating Systems Review, V37, P29, DOI 10.1145/1165389.945450