A Family of Binary Locally Repairable Codes for Coded Distributed Computing

被引:1
作者
Qharabagh, Muhammad Fetrat [1 ]
Ardakani, Masoud [2 ]
机构
[1] Univ Waterloo, David R Cheriton Sch Comp Sci, Waterloo, ON N2L 3G1, Canada
[2] Univ Alberta, Dept Elect & Comp Engn, Edmonton T6G 2R3, AB, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Codes; Encoding; Task analysis; Decoding; Complexity theory; Distributed computing; Delay effects; Coded distributed computing; stragglers; error-correction codes; binary codes; locally repairable codes; minimum distance separable codes; computational delay;
D O I
10.1109/TCOMM.2023.3322174
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One of the main bottlenecks in distributed computing systems is the stragglers' problem. Error correction codes have been proposed to alleviate this problem at the cost of coding complexity for the master node. In this work, we aim to reduce this coding complexity and propose a novel family of binary locally repairable codes (BLRC) to encode the distributed tasks in a linear matrix-vector multiplication problem. In comparison to the widely used maximum distance separable (MDS) codes, our proposed codes (i) eliminate the costly multiplication operations from the encoding and decoding processes, (ii) allow for low-complexity recovery within the local groups. We analyze the complexity of our proposed codes and through simulations show that compared to MDS codes, our codes reduce the overall encoding plus computation plus decoding time by more than 35% in many practical scenarios.
引用
收藏
页码:50 / 62
页数:13
相关论文
共 50 条
  • [1] Distributed Decoding for Coded Distributed Computing
    Yazdanialahabadi, Arash
    Ardakani, Masoud
    IEEE INTERNET OF THINGS JOURNAL, 2021, 9 (14) : 12555 - 12562
  • [2] Binary Linear Locally Repairable Codes
    Huang, Pengfei
    Yaakobi, Eitan
    Uchikawa, Hironori
    Siegel, Paul H.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (11) : 6268 - 6283
  • [3] Coded Distributed Computing With Partial Recovery
    Ozfatura, Emre
    Ulukus, Sennur
    Gunduz, Deniz
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (03) : 1945 - 1959
  • [4] On Allocation of Systematic Blocks in Coded Distributed Computing
    Ardakani, Maryam Haghighi
    Mehrabi, Mehrad
    Ardakani, Masoud
    Tellambura, Chintha
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (04) : 748 - 752
  • [5] On Binary Cyclic Locally Repairable Codes with Locality 2
    Rao, Yi
    Li, Ruihu
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2017, E100A (07) : 1588 - 1591
  • [6] Secure Locally Repairable Codes for Distributed Storage Systems
    Rawat, Ankit Singh
    Koyluoglu, O. Ozan
    Silberstein, Natalia
    Vishwanath, Sriram
    2013 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2013, : 2224 - 2228
  • [7] Hypergraph-Based Binary Locally Repairable Codes With Availability
    Kim, Jung-Hyun
    Song, Hong-Yeop
    IEEE COMMUNICATIONS LETTERS, 2017, 21 (11) : 2332 - 2335
  • [8] Constructions of Binary Locally Repairable Codes With Multiple Recovering Sets
    Teng, Jiaming
    Jin, Lingfei
    IEEE ACCESS, 2021, 9 : 92239 - 92245
  • [9] On Lengths of Singleton-Optimal Locally Repairable Codes
    Liu, Shu
    Wu, Ting-Yi
    Xing, Chaoping
    Yuan, Chen
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (01) : 3 - 12
  • [10] Optimal Locally Repairable and Secure Codes for Distributed Storage Systems
    Rawat, Ankit Singh
    Koyluoglu, Onur Ozan
    Silberstein, Natalia
    Vishwanath, Sriram
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (01) : 212 - 236