Repair Rate Lower Bounds for Distributed Storage

被引:2
|
作者
Luby, Michael [1 ,2 ,3 ]
机构
[1] Qualcomm Technol Inc, San Diego, CA 92121 USA
[2] Int Comp Sci Inst, Berkeley, CA 94704 USA
[3] BitRipple Inc, Berkeley, CA 94708 USA
基金
美国国家科学基金会;
关键词
Distributed databases; Liquids; Reed-Solomon codes; Maintenance engineering; Data models; Transient analysis; Indexes; IEEEtran; journal; LaTeX; paper; template;
D O I
10.1109/TIT.2021.3052488
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A primary objective of a distributed storage system is to reliably store huge amounts of source data for long periods of time using a large number of high storage capacity nodes. Storage nodes are prone to permanent failures, where such node failures cause all stored data to be permanently lost, and failed nodes are replaced with nodes that initially store no data. To maintain recoverability of the source data as storage nodes fail and are replaced, a total amount of storage capacity that is larger than the source data size is allocated to store the source data, and a repairer continually reads data from and writes data to the storage nodes as they fail and are replaced. We prove information-theoretic lower bounds on the rate at which a repairer reads data from the storage system as a function of the rate at which nodes fail and the amount by which the allocated storage capacity exceeds the source data size. These lower bounds hold for any repairer, i.e., any repairer that does not read data at or above the lower bound rate will provably not maintain recoverability of the source data. The bounds are provably tight asymptotically as the number of storage nodes grows and the allocated storage capacity approaches the source data size.
引用
收藏
页码:5711 / 5730
页数:20
相关论文
共 50 条
  • [1] New Bounds for Distributed Storage Systems with Secure Repair
    Tandon, Ravi
    Mohajer, Soheil
    2014 52ND ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2014, : 431 - 436
  • [2] Guessing Cost: Bounds and Applications to Data Repair in Distributed Storage
    Arslan, Suayb S.
    Haytaoglu, Elif
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2024, 70 (10) : 6757 - 6779
  • [3] Alphabet-size dependent bounds for Exact Repair in Distributed Storage
    Cadambe, Viveck
    Mazumdar, Arya
    2015 IEEE INFORMATION THEORY WORKSHOP - FALL (ITW), 2015, : 1 - 3
  • [4] New Codes and Inner Bounds for Exact Repair in Distributed Storage Systems
    Goparaju, Sreechakra
    El Rouayheb, Salim
    Calderbank, Robert
    2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 1036 - 1040
  • [5] New Codes and Inner Bounds for Exact Repair in Distributed Storage Systems
    Goparaju, Sreechakra
    El Rouayheb, Salim
    Calderbank, Robert
    2014 48TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS (CISS), 2014,
  • [6] Lower bounds in distributed computing
    Fich, F
    Ruppert, E
    DISTRIBUTED COMPUTING, PROCEEDINGS, 2000, 1914 : 1 - 28
  • [7] Exact Repair for Distributed Storage Systems: Partial Characterization via New Bounds
    Mohajer, Soheil
    Tandon, Ravi
    2015 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA), 2015, : 130 - 135
  • [8] Lower Bounds on Bandwidth Requirements of Regenerating Code Parameter Scaling in Distributed Storage Systems
    Zolfaghari, Behrouz
    Singh, Vikrant
    Reddy, Sushmitha
    Rai, Brijesh Kumar
    Bibak, Khodakhast
    Dehghantanha, Ali
    IEEE COMMUNICATIONS LETTERS, 2021, 25 (05) : 1477 - 1481
  • [9] THE LOWER BOUNDS ON DISTRIBUTED SHORTEST PATHS
    RAMARAO, KVS
    VENKATESAN, S
    INFORMATION PROCESSING LETTERS, 1993, 48 (03) : 145 - 149
  • [10] Distributed Lower Bounds for Ruling Sets
    Balliu, Alkida
    Brandt, Sebastian
    Olivetti, Dennis
    2020 IEEE 61ST ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS 2020), 2020, : 365 - 376