Guessing Cost: Bounds and Applications to Data Repair in Distributed Storage

被引:0
|
作者
Arslan, Suayb S. [1 ,2 ]
Haytaoglu, Elif [3 ]
机构
[1] MIT, Dept Brain & Cognit Sci, Cambridge, MA 02139 USA
[2] Bogazici Univ, Dept Comp Engn, TR-34396 Istanbul, Turkiye
[3] Pamukkale Univ, Dept Comp Engn, TR-20160 Denizli, Turkiye
关键词
Costs; Random variables; Codes; Entropy; Protocols; Parity check codes; Decoding; Guessing; entropy; moments; bounds; cellular networks; sparse graph codes; LDPC; repair bandwidth; RENYI ENTROPY; GUESSWORK; RELIABILITY; INEQUALITY; DESIGN;
D O I
10.1109/TIT.2023.3339066
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The guesswork refers to the distribution of the minimum number of trials needed to guess a realization of a random variable accurately. In this study, a non-trivial generalization of the guesswork called guessing cost (also referred to as cost of guessing) is introduced, and an optimal strategy for finding the $\rho $ -th moment of guessing cost is provided for a random variable defined on a finite set whereby each choice is associated with a positive finite cost value (unit cost corresponds to the original guesswork). Moreover, we drive asymptotically tight upper and lower bounds on the logarithm of guessing cost moments. Similar to previous studies on the guesswork, established bounds on the moments of guessing cost quantify the accumulated cost of guesses required for correctly identifying the unknown choice and are expressed in terms of R & eacute;nyi's entropy. Moreover, new random variables are introduced to establish connections between the guessing cost and the guesswork, leading to induced strategies. Establishing this implicit connection helped us obtain improved bounds for the non-asymptotic region. As a consequence, we establish the guessing cost exponent in terms of R & eacute;nyi entropy rate on the moments of the guessing cost using the optimal strategy by considering a sequence of independent random variables with different cost distributions. Finally, with slight modifications to the original problem, these results are shown to be applicable for bounding the overall repair bandwidth for distributed data storage systems backed up by base stations and protected by bipartite graph codes.
引用
收藏
页码:6757 / 6779
页数:23
相关论文
共 50 条
  • [21] Tight Bounds on the Renyi Entropy via Majorization with Applications to Guessing and Compression
    Sason, Igal
    ENTROPY, 2018, 20 (12)
  • [22] Quantifying the Cost of Privately Storing Data in Distributed Storage Systems
    Chou, Remi A.
    2022 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, ISIT, 2022, : 3274 - 3279
  • [23] Quantifying the Cost of Privately Storing Data in Distributed Storage Systems
    Chou, Remi A.
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (11) : 7485 - 7499
  • [24] Network Topology Impacts on Repair Cost in Distributed Storage System with Network Coding
    Qin, Shengwei
    Li, Zhong
    2018 IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION ENGINEERING (ICECE 2018), 2018, : 102 - 109
  • [25] Optimal-Cost Repair in Multi-hop Distributed Storage Systems
    Gerami, Majid
    Xiao, Ming
    Skoglund, Mikael
    2011 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2011, : 1437 - 1441
  • [26] Data Repair for Distributed, Event-based IoT Applications
    Lin, Wei-Tsung
    Bakir, Fatih
    Krintz, Chandra
    Wolski, Rich
    Mock, Markus
    DEBS'19: PROCEEDINGS OF THE 13TH ACM INTERNATIONAL CONFERENCE ON DISTRIBUTED AND EVENT-BASED SYSTEMS, 2019, : 139 - 150
  • [27] NSM: A distributed storage architecture for data-intensive applications
    Ali, Z
    Malluhi, Q
    20TH IEEE/11TH NASA GODDARD CONFERENCE ON MASS STORAGE AND TECHNOLOGIES (MSST 2003), PROCEEDINGS, 2003, : 87 - 91
  • [28] Tradeoff between Storage Cost and Repair Cost for Cloud Storage
    Liu, Pengfei
    Zheng, Lin
    Yu, Quan
    Ye, Huiying
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA ANALYSIS (ICCCBDA), 2018, : 169 - 173
  • [29] Novel Latency Bounds for Distributed Coded Storage
    Parag, Parimal
    Chamberland, Jean-Francois
    2018 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA), 2018,
  • [30] LINEAR PROGRAMMING BOUNDS FOR DISTRIBUTED STORAGE CODES
    Tebbi, Ali
    Chan, Terence
    Sung, Chi Wan
    ADVANCES IN MATHEMATICS OF COMMUNICATIONS, 2020, 14 (02) : 333 - 357