On accurate prediction of cloud workloads with adaptive pattern mining

被引:10
作者
Bao, Liang [1 ]
Yang, Jin [1 ]
Zhang, Zhengtong [1 ]
Liu, Wenjing [1 ]
Chen, Junhao [1 ]
Wu, Chase [2 ]
机构
[1] XiDian Univ, Sch Comp Sci & Technol, Xian 710071, Shaanxi, Peoples R China
[2] New Jersey Inst Technol, Newark, NJ 07102 USA
基金
中国国家自然科学基金;
关键词
Cloud computing; Workload prediction; Pattern mining; Ensemble method; RESOURCE USAGE PREDICTION; HOST LOAD PREDICTION; MODEL; ALGORITHM;
D O I
10.1007/s11227-022-04647-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Resource provisioning for cloud computing requires adaptive and accurate prediction of cloud workloads. However, existing studies in workload prediction have faced significant challenges in predicting time-varying cloud workloads of diverse trends and patterns, and the lack of accurate prediction often results in resource waste and violation of Service-Level Agreements (SLAs). We propose a bagging-like ensemble framework for cloud workload prediction with Adaptive Pattern Mining (APM). Within this framework, we first design a two-step method with various models to simultaneously capture the "low frequency" and "high frequency" characteristics of highly variable workloads. For a given workload, we further develop an error-based weights aggregation method to integrate the prediction results from multiple pattern-specific models into a final result to predict a future workload. We conduct experiments to demonstrate the efficacy of APM in workload prediction with various prediction lengths using two real-world workload traces from Google and Alibaba cloud data centers, which are of different types. Extensive experimental results show that APM achieves above 19.62% improvement over several classic and state-of-the-art workload prediction methods for highly variable real-world cloud workloads.
引用
收藏
页码:160 / 187
页数:28
相关论文
共 44 条
[1]   An online learning model based on episode mining for workload prediction in cloud [J].
Amiri, Maryam ;
Mohammad-Khanli, Leyli ;
Mirandola, Raffaela .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 :83-101
[2]   A sequential pattern mining model for application workload prediction in cloud environment [J].
Amiri, Maryam ;
Mohammad-Khanli, Leyli ;
Mirandola, Raffaela .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2018, 105 :21-62
[3]  
[Anonymous], 2017, ALIBABA CLUSTER TRAC
[4]  
[Anonymous], Google cluster-usage traces
[5]  
Berral J.L., 2020, AI4DL MINING BEHAV D, DOI 10.5555/3485849.3485852
[6]  
Box G.E.P., 1970, Time series analysis: forecasting and control, DOI 10.1080/01621459.1970.10481180
[7]  
Breiman L, 1996, MACH LEARN, V24, P123, DOI 10.1023/A:1018054314350
[8]   CPU load prediction for cloud environment based on a dynamic ensemble model [J].
Cao, Jian ;
Fu, Jiwen ;
Li, Minglu ;
Chen, Jinjun .
SOFTWARE-PRACTICE & EXPERIENCE, 2014, 44 (07) :793-804
[9]   AME-WPC: Advanced model for efficient workload prediction in the cloud [J].
Cetinski, Katja ;
Juric, Matjaz B. .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2015, 55 :191-201
[10]  
Chen MS, 2020, PR MACH LEARN RES, V108, P1233