On the Delay-Storage Trade-Off in Content Download from Coded Distributed Storage Systems

被引:127
作者
Joshi, Gauri [1 ]
Liu, Yanpei [2 ]
Soljanin, Emina [3 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] Univ Wisconsin, Dept Elect & Comp Engn, Madison, WI 53706 USA
[3] Alcatel Lucent, Bell Labs, Murray Hill, NJ USA
关键词
distributed storage; fork-join queues; MDS codes;
D O I
10.1109/JSAC.2014.140518
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We study how coding in distributed storage reduces expected download time, in addition to providing reliability against disk failures. The expected download time is reduced because when a content file is encoded with redundancy and distributed across multiple disks, reading only a subset of the disks is sufficient for content reconstruction. For the same total storage used, coding exploits the diversity in storage better than simple replication, and hence gives faster download. We use a novel fork-join queueing framework to model multiple users requesting the content simultaneously, and derive bounds on the expected download time. Our system model and results are a novel generalization of the fork-join system that is studied in queueing theory literature. Our results demonstrate the fundamental trade-off between the expected download time and the amount of storage space. This trade-off can be used for design of the amount of redundancy required to meet the delay constraints on content delivery.
引用
收藏
页码:989 / 997
页数:9
相关论文
共 33 条
[1]  
[Anonymous], 2003, P 19 ACM S OP SYST P, DOI [10.1145/1165389.945450, DOI 10.1145/1165389.945450]
[2]   BOUNDS ON EXPECTATIONS OF LINEAR SYSTEMATIC STATISTICS BASED ON DEPENDENT SAMPLES [J].
ARNOLD, BC ;
GROENEVELD, RA .
ANNALS OF STATISTICS, 1979, 7 (01) :220-223
[3]   EVENODD - AN EFFICIENT SCHEME FOR TOLERATING DOUBLE-DISK FAILURES IN RAID ARCHITECTURES [J].
BLAUM, M ;
BRADY, J ;
BRUCK, J ;
MENON, J .
IEEE TRANSACTIONS ON COMPUTERS, 1995, 44 (02) :192-202
[4]   Power-Reduction Techniques for Data-Center Storage Systems [J].
Bostoen, Tom ;
Mullender, Sape ;
Berbers, Yolande .
ACM COMPUTING SURVEYS, 2013, 45 (03)
[5]   Self-similarity in World Wide Web traffic: Evidence and possible causes [J].
Crovella, ME ;
Bestavros, A .
IEEE-ACM TRANSACTIONS ON NETWORKING, 1997, 5 (06) :835-846
[6]  
Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[7]   Network coding for distributed storage systems [J].
Dimakis, Alexandros G. ;
Godfrey, P. Brighten ;
Wainwright, Martin J. ;
Ramchandran, Kannan .
INFOCOM 2007, VOLS 1-5, 2007, :2000-+
[8]   ASSOCIATION OF RANDOM VARIABLES WITH APPLICATIONS [J].
ESARY, JD ;
PROSCHAN, F ;
WALKUP, DW .
ANNALS OF MATHEMATICAL STATISTICS, 1967, 38 (05) :1466-&
[9]  
Faloutsos M, 1999, COMP COMM R, V29, P251, DOI 10.1145/316194.316229
[10]  
Ferner UJ, 2012, ANN ALLERTON CONF, P517, DOI 10.1109/Allerton.2012.6483262