Integrated deep learning method for workload and resource prediction cloud systems

被引:96
作者
Bi, Jing [1 ]
Li, Shuang [1 ]
Yuan, Haitao [2 ]
Zhou, MengChu [3 ]
机构
[1] Beijing Univ Technol, Sch Software Engn, Fac Informat Technol, Beijing 100124, Peoples R China
[2] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[3] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
基金
中国国家自然科学基金;
关键词
Cloud data centers; BG-LSTM; Hybrid prediction; Savitzky-Golay filter; Deep learning; TIME-SERIES PREDICTION; CLASSIFICATION; NETWORK;
D O I
10.1016/j.neucom.2020.11.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cloud computing providers face several challenges in precisely forecasting large-scale workload and resource time series. Such prediction can help them to achieve intelligent resource allocation for guaranteeing that users' performance needs are strictly met with no waste of computing, network and storage resources. This work applies a logarithmic operation to reduce the standard deviation before smoothing workload and resource sequences. Then, noise interference and extreme points are removed via a powerful filter. A Min-Max scaler is adopted to standardize the data. An integrated method of deep learning for prediction of time series is designed. It incorporates network models including both bi-directional and grid long short-term memory network to achieve high-quality prediction of workload and resource time series. The experimental comparison demonstrates that the prediction accuracy of the proposed method is better than several widely adopted approaches by using datasets of Google cluster trace. (c) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:35 / 48
页数:14
相关论文
共 60 条
[1]  
Alam Mansaf, 2016, 2016 19th IEEE International Conference on Computational Science and Engineering (CSE), IEEE 14th International Conference on Embedded and Ubiquitous Computing (EUC), and 15th International Symposium on Distributed Computing and Applications for Business Engineering (DCABES). Proceedings, P740, DOI 10.1109/CSE-EUC-DCABES.2016.271
[2]  
Amvrosiadis G, 2018, PROCEEDINGS OF THE 2018 USENIX ANNUAL TECHNICAL CONFERENCE, P533
[3]   A Forecasting Methodology for Workload Forecasting in Cloud Systems [J].
Baldan, Francisco J. ;
Ramirez-Gallego, Sergio ;
Bergmeir, Christoph ;
Herrera, Francisco ;
Benitez, Jose M. .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2018, 6 (04) :929-941
[4]   Memory analysis for memristors and memristive recurrent neural networks [J].
Bao, Gang ;
Zhang, Yide ;
Zeng, Zhigang .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (01) :96-105
[5]   Multi-step-ahead time series prediction using multiple-output support vector regression [J].
Bao, Yukun ;
Xiong, Tao ;
Hu, Zhongyi .
NEUROCOMPUTING, 2014, 129 :482-493
[6]   Deep learning and time series-to-image encoding for financial forecasting [J].
Barra, Silvio ;
Carta, Salvatore Mario ;
Corriga, Andrea ;
Podda, Alessandro Sebastian ;
Recupero, Diego Reforgiato .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (03) :683-692
[7]   Multiple-output modeling for multi-step-ahead time series forecasting [J].
Ben Taieb, Souhaib ;
Sorjamaa, Antti ;
Bontempi, Gianluca .
NEUROCOMPUTING, 2010, 73 (10-12) :1950-1957
[8]   Temporal Prediction of Multiapplication Consolidated Workloads in Distributed Clouds [J].
Bi, Jing ;
Yuan, Haitao ;
Zhou, Mengchu .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2019, 16 (04) :1763-1773
[9]  
Bi J, 2019, IEEE INT C NETW SENS, P86, DOI [10.1109/icnsc.2019.8743188, 10.1109/ICNSC.2019.8743188]
[10]   Workload Prediction Using ARIMA Model and Its Impact on Cloud Applications' QoS [J].
Calheiros, Rodrigo N. ;
Masoumi, Enayat ;
Ranjan, Rajiv ;
Buyya, Rajkumar .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2015, 3 (04) :449-458