Mean-Field Analysis of Coding Versus Replication in Large Data Storage Systems

被引:7
作者
Li, Bin [1 ]
Ramamoorthy, Aditya [2 ]
Srikant, R. [3 ,4 ]
机构
[1] Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
[2] Iowa State Univ, Dept Elect & Comp Engn, Ames, IA USA
[3] Univ Illinois, Dept Elect & Comp Engn, 1406 W Green St, Urbana, IL 61801 USA
[4] Univ Illinois, Coordinated Sci Lab, 1101 W Springfield Ave, Urbana, IL 61801 USA
关键词
Cloud storage systems; load-balancing; file coding; mean-field-analysis; heavy-traffic analysis;
D O I
10.1145/3159172
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We study cloud storage systems with a very large number of files stored in a very large number of servers. In such systems, files are either replicated or coded to ensure reliability, i.e., to guarantee file recovery from server failures. This redundancy in storage can further be exploited to improve system performance (mean file-access delay) through appropriate load-balancing (routing) schemes. However, it is unclear whether coding or replication is better from a system performance perspective since the corresponding queueing analysis of such systems is, in general, quite difficult except for the trivial case when the system load asymptotically tends to zero. Here, we study the more difficult case where the system load is not asymptotically zero. Using the fact that the system size is large, we obtain a mean-field limit for the steady-state distribution of the number of file access requests waiting at each server. We then use the mean-field limit to show that, for a given storage capacity per file, coding strictly outperforms replication at all traffic loads while improving reliability. Further, the factor by which the performance improves in the heavy traffic is at least as large as in the light-traffic case. Finally, we validate these results through extensive simulations.
引用
收藏
页数:28
相关论文
共 33 条
[1]  
Ananthanarayanan G., 2012, P USENIX C HOT TOP C
[2]  
Bramson M., 2010, P ACM INT C MEAS MOD
[3]  
Chen S., 2014, P IEEE INT C COMP CO
[4]  
Gardner K., 2015, P ACM INT C MEAS MOD
[5]   Redundancy-d: The Power of d Choices for Redundancy [J].
Gardner, Kristen ;
Harchol-Balter, Mor ;
Scheller-Wolf, Alan ;
Velednitsky, Mark ;
Zbarsky, Samuel .
OPERATIONS RESEARCH, 2017, 65 (04) :1078-1094
[6]  
Hajek B., 2006, NOTES ECE 467 COMMUN
[7]  
Huang LB, 2012, IEEE INT SYMP INFO
[8]  
Jain S., 2005, P ACM C APPL TECHN A
[9]  
Joshi G., 2015, EVALUATION REV, V43, P54
[10]  
Joshi G., 2015, P 53 ANN ALL C COMM