A Family of Binary Locally Repairable Codes for Coded Distributed Computing

被引:1
作者
Qharabagh, Muhammad Fetrat [1 ]
Ardakani, Masoud [2 ]
机构
[1] Univ Waterloo, David R Cheriton Sch Comp Sci, Waterloo, ON N2L 3G1, Canada
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton T6G 2R3, AB, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Codes; Encoding; Task analysis; Decoding; Complexity theory; Distributed computing; Delay effects; Coded distributed computing; stragglers; error-correction codes; binary codes; locally repairable codes; minimum distance separable codes; computational delay;
D O I
10.1109/TCOMM.2023.3322174
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One of the main bottlenecks in distributed computing systems is the stragglers' problem. Error correction codes have been proposed to alleviate this problem at the cost of coding complexity for the master node. In this work, we aim to reduce this coding complexity and propose a novel family of binary locally repairable codes (BLRC) to encode the distributed tasks in a linear matrix-vector multiplication problem. In comparison to the widely used maximum distance separable (MDS) codes, our proposed codes (i) eliminate the costly multiplication operations from the encoding and decoding processes, (ii) allow for low-complexity recovery within the local groups. We analyze the complexity of our proposed codes and through simulations show that compared to MDS codes, our codes reduce the overall encoding plus computation plus decoding time by more than 35% in many practical scenarios.
引用
收藏
页码:50 / 62
页数:13
相关论文
共 50 条
[21]   Asymptotic Bounds on the Rate of Locally Repairable Codes [J].
Roth, Ron M. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (03) :1581-1598
[22]   On Batch-Processing Based Coded Computing for Heterogeneous Distributed Computing Systems [J].
Wang, Baoqian ;
Xie, Junfei ;
Lu, Kejie ;
Wan, Yan ;
Fu, Shengli .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (03) :2438-2454
[23]   An Efficient Binary Locally Repairable Code for Hadoop Distributed File System [J].
Shahabinejad, Mostafa ;
Khabbazian, Majid ;
Ardakani, Masoud .
IEEE COMMUNICATIONS LETTERS, 2014, 18 (08) :1287-1290
[24]   Worker Assignment for Multiple Masters to Speed Up Coded Distributed Computing in Heterogeneous Clusters [J].
Kim, Daejin ;
Park, Hyegyeong ;
Niyato, Dusit ;
Choi, Junkyun .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (03) :2283-2298
[25]   Secure and Flexible Coded Distributed Matrix Multiplication Based on Edge Computing for Industrial Metaverse [J].
Qiu, Houming ;
Zhu, Kun ;
Niyato, Dusit .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) :1026-1041
[26]   Asymptotically Optimal Coded Distributed Computing via Combinatorial Designs [J].
Cheng, Minquan ;
Wu, Youlong ;
Li, Xianxian ;
Wu, Dianhua .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (04) :3018-3033
[27]   On Minimum Distance of Locally Repairable Codes [J].
Mehrabi, Mehrtash ;
Ardakani, Masoud .
2017 15TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2017,
[28]   List Decoding of Locally Repairable Codes [J].
Holzbaur, Lukas ;
Wachter-Zeh, Antonia .
2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, :1331-1335
[29]   Optimal Constacyclic Locally Repairable Codes [J].
Sun, Zhonghua ;
Zhu, Shixin ;
Wang, Liqi .
IEEE COMMUNICATIONS LETTERS, 2019, 23 (02) :206-209
[30]   Locally Repairable Fractional Repetition Codes [J].
Nam, Mi-Young ;
Kim, Jung-Hyun ;
Song, Hong-Yeop .
2015 SEVENTH INTERNATIONAL WORKSHOP ON SIGNAL DESIGN AND ITS APPLICATIONS IN COMMUNICATIONS (IWSDA), 2015, :128-132