Long range dependence in cloud servers: a statistical analysis based on Google workload trace

被引:10
作者
Gupta, Shaifu [1 ]
Dileep, A. D. [1 ]
机构
[1] Indian Inst Technol Mandi, Sch Comp & Elect Engn, Kamand 175005, Himachal Prades, India
关键词
Long range dependence; Heavy tails; Cloud; Workload; SELF-SIMILARITY;
D O I
10.1007/s00607-019-00779-4
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Analysis and characterization of cloud workloads provides crucial information for designing optimal resource management policies. In this work, we propose to analyse long range dependence nature of cloud resource workloads. Long range dependence is a phenomenon widely studied in Ethernet and Internet traffic. But there is a dearth of works that analyse long range dependence in cloud workloads. In this work, we propose to verify the presence of long range dependence in cloud workloads using autocorrelation analysis and rescaled range analysis method. In addition to experimental evidence, studies on long range dependence are incomplete without a sound theoretical justification in support of its origins in cloud workloads. In this context, we propose to analytically analyse, aggregate workload in the datacenter using different metrics like arrival, service distributions of jobs and their resource usage. For a dependable explanation of long range dependence in cloud workloads, we analyse workloads from standard real dataset of Google cluster trace. Based on the analysis, we see that analysed metrics display heavy tailed behaviour and using a mathematical formulation, we prove that aggregate workload exhibits long range dependence.
引用
收藏
页码:1031 / 1049
页数:19
相关论文
共 23 条
[1]   IoT-Fog Optimal Workload via Fog Offloading [J].
Al-khafajiy, Mohammed ;
Baker, Thar ;
Waraich, Atif ;
Al-Jumeily, Dhiya ;
Hussain, Abir .
2018 IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING COMPANION (UCC COMPANION), 2018, :359-364
[2]  
Alam Mansaf, 2016, 2016 19th IEEE International Conference on Computational Science and Engineering (CSE), IEEE 14th International Conference on Embedded and Ubiquitous Computing (EUC), and 15th International Symposium on Distributed Computing and Applications for Business Engineering (DCABES). Proceedings, P740, DOI 10.1109/CSE-EUC-DCABES.2016.271
[3]   Dual time-scale distributed capacity allocation and load redirect algorithms for cloud systems [J].
Ardagna, Danilo ;
Casolari, Sara ;
Colajanni, Michele ;
Panicucci, Barbara .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2012, 72 (06) :796-808
[4]   Energy-Aware Autonomic Resource Allocation in Multitier Virtualized Environments [J].
Ardagna, Danilo ;
Panicucci, Barbara ;
Trubian, Marco ;
Zhang, Li .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2012, 5 (01) :2-19
[5]   SUBEXPONENTIALITY OF THE PRODUCT OF INDEPENDENT RANDOM-VARIABLES [J].
CLINE, DBH ;
SAMORODNITSKY, E .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1994, 49 (01) :75-98
[6]   fitdistrplus: An R Package for Fitting Distributions [J].
Delignette-Muller, Marie Laure ;
Dutang, Christophe .
JOURNAL OF STATISTICAL SOFTWARE, 2015, 64 (04) :1-34
[7]  
Doukhan P., 2002, Theory and Applications of Long-Range Dependence
[8]   Measurement and modelling of self-similar traffic in computer networks [J].
Field, AJ ;
Harder, U ;
Harrison, PG .
IEE PROCEEDINGS-COMMUNICATIONS, 2004, 151 (04) :355-363
[9]   Some comments on Hurst exponent and the long memory processes on capital markets [J].
Granero, M. A. Sanchez ;
Segovia, J. E. Trinidad ;
Perez, J. Garcia .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2008, 387 (22) :5543-5551
[10]  
Grossglauser M, 1999, IEEE ACM T NETWORK, V7, P629, DOI 10.1145/248157.248159