Download Time Analysis for Distributed Storage Codes With Locality and Availability

被引:6
作者
Aktas, Mehmet Fatih [1 ]
Kadhe, Swanand [2 ]
Soljanin, Emina [1 ]
Sprintson, Alex [3 ]
机构
[1] Rutgers State Univ, Dept ECE, Piscataway, NJ 08854 USA
[2] Univ Calif Berkeley, Dept EECS, Berkeley, CA 94720 USA
[3] Texas A&M Univ, Dept ECE, College Stn, TX 77843 USA
关键词
Systematics; Redundancy; Numerical simulation; Servers; Queueing analysis; Distributed coded storage; availability; download with redundancy; ARRIVALS;
D O I
10.1109/TCOMM.2021.3067054
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The paper presents techniques for analyzing the expected download time in distributed storage systems that employ systematic availability codes. These codes provide access to hot data through the systematic server containing the object and multiple recovery groups. When a request for an object is received, it can be replicated (forked) to the systematic server and all recovery groups. We first consider the low-traffic regime and present the close-form expression for the download time. By comparison across systems with availability, maximum distance separable (MDS), and replication codes, we demonstrate that availability codes can reduce download time in some settings but are not always optimal. In the high-traffic regime, the system contains multiple inter-dependent Fork-Join queues, making exact analysis intractable. Accordingly, we present upper and lower bounds on the download time, and an M/G/1 queue approximation for several cases of interest. Via extensive numerical simulations, we evaluate our bounds and demonstrate that the M/G/1 queue approximation has a high degree of accuracy.
引用
收藏
页码:3898 / 3910
页数:13
相关论文
共 35 条
[1]  
Aktas Mehmet Fatih, 2017, ACM SIGMETRICS Performance Evaluation Review, V45, P35, DOI 10.1145/3143314.3078553
[2]  
Aktas M. F., 2020, THESIS RUTGERS U NEW
[3]  
Aktas MF, 2018, IEEE INT SYMP INFO, P1929, DOI 10.1109/ISIT.2018.8437518
[4]  
Ananthanarayanan G, 2011, EUROSYS 11: PROCEEDINGS OF THE EUROSYS 2011 CONFERENCE, P287
[5]  
[Anonymous], 2012, P USENIX ATC
[6]   Bounds on the Size of Locally Recoverable Codes [J].
Cadambe, Viveck R. ;
Mazumdar, Arya .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2015, 61 (11) :5787-5794
[7]   The Tail at Scale [J].
Dean, Jeffrey ;
Barroso, Luiz Andre .
COMMUNICATIONS OF THE ACM, 2013, 56 (02) :74-80
[8]  
DeCandia Giuseppe, 2007, Operating Systems Review, V41, P205, DOI 10.1145/1323293.1294281
[9]   A Survey on Network Codes for Distributed Storage [J].
Dimakis, Alexandros G. ;
Ramchandran, Kannan ;
Wu, Yunnan ;
Suh, Changho .
PROCEEDINGS OF THE IEEE, 2011, 99 (03) :476-489
[10]   2 PARALLEL QUEUES CREATED BY ARRIVALS WITH 2 DEMANDS .1. [J].
FLATTO, L ;
HAHN, S .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1984, 44 (05) :1041-1053