A Family of Binary Locally Repairable Codes for Coded Distributed Computing

被引:1
作者
Qharabagh, Muhammad Fetrat [1 ]
Ardakani, Masoud [2 ]
机构
[1] Univ Waterloo, David R Cheriton Sch Comp Sci, Waterloo, ON N2L 3G1, Canada
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton T6G 2R3, AB, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Codes; Encoding; Task analysis; Decoding; Complexity theory; Distributed computing; Delay effects; Coded distributed computing; stragglers; error-correction codes; binary codes; locally repairable codes; minimum distance separable codes; computational delay;
D O I
10.1109/TCOMM.2023.3322174
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One of the main bottlenecks in distributed computing systems is the stragglers' problem. Error correction codes have been proposed to alleviate this problem at the cost of coding complexity for the master node. In this work, we aim to reduce this coding complexity and propose a novel family of binary locally repairable codes (BLRC) to encode the distributed tasks in a linear matrix-vector multiplication problem. In comparison to the widely used maximum distance separable (MDS) codes, our proposed codes (i) eliminate the costly multiplication operations from the encoding and decoding processes, (ii) allow for low-complexity recovery within the local groups. We analyze the complexity of our proposed codes and through simulations show that compared to MDS codes, our codes reduce the overall encoding plus computation plus decoding time by more than 35% in many practical scenarios.
引用
收藏
页码:50 / 62
页数:13
相关论文
共 50 条
  • [21] On Batch-Processing Based Coded Computing for Heterogeneous Distributed Computing Systems
    Wang, Baoqian
    Xie, Junfei
    Lu, Kejie
    Wan, Yan
    Fu, Shengli
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (03): : 2438 - 2454
  • [22] An Efficient Binary Locally Repairable Code for Hadoop Distributed File System
    Shahabinejad, Mostafa
    Khabbazian, Majid
    Ardakani, Masoud
    IEEE COMMUNICATIONS LETTERS, 2014, 18 (08) : 1287 - 1290
  • [23] Worker Assignment for Multiple Masters to Speed Up Coded Distributed Computing in Heterogeneous Clusters
    Kim, Daejin
    Park, Hyegyeong
    Niyato, Dusit
    Choi, Junkyun
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (03) : 2283 - 2298
  • [24] Secure and Flexible Coded Distributed Matrix Multiplication Based on Edge Computing for Industrial Metaverse
    Qiu, Houming
    Zhu, Kun
    Niyato, Dusit
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2024, 12 (04) : 1026 - 1041
  • [25] Asymptotically Optimal Coded Distributed Computing via Combinatorial Designs
    Cheng, Minquan
    Wu, Youlong
    Li, Xianxian
    Wu, Dianhua
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (04) : 3018 - 3033
  • [26] On Minimum Distance of Locally Repairable Codes
    Mehrabi, Mehrtash
    Ardakani, Masoud
    2017 15TH CANADIAN WORKSHOP ON INFORMATION THEORY (CWIT), 2017,
  • [27] Optimal Constacyclic Locally Repairable Codes
    Sun, Zhonghua
    Zhu, Shixin
    Wang, Liqi
    IEEE COMMUNICATIONS LETTERS, 2019, 23 (02) : 206 - 209
  • [28] Locally Repairable Fractional Repetition Codes
    Nam, Mi-Young
    Kim, Jung-Hyun
    Song, Hong-Yeop
    2015 SEVENTH INTERNATIONAL WORKSHOP ON SIGNAL DESIGN AND ITS APPLICATIONS IN COMMUNICATIONS (IWSDA), 2015, : 128 - 132
  • [29] List Decoding of Locally Repairable Codes
    Holzbaur, Lukas
    Wachter-Zeh, Antonia
    2018 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2018, : 1331 - 1335
  • [30] Optimal ternary locally repairable codes
    Hao, Jie
    Xia, Shu-Tao
    Shum, Kenneth W.
    Chen, Bin
    Fu, Fang-Wei
    Yang, Yixian
    DESIGNS CODES AND CRYPTOGRAPHY, 2024, 92 (09) : 2685 - 2704