Machine Learning-Based Temperature Prediction for Runtime Thermal Management Across System Components

被引:81
作者
Zhang, Kaicheng [1 ]
Guliani, Akhil [1 ]
Ogrenci-Memik, Seda [1 ]
Memik, Gokhan [1 ]
Yoshii, Kazutomo [2 ]
Sankaran, Rajesh [2 ]
Beckman, Pete [2 ]
机构
[1] Northwestern Univ, Dept Elect Engn & Comp Sci, 2145 Sheridan Rd, Evanston, IL 60208 USA
[2] Argonne Natl Lab, Math & Comp Sci Div, 9700 South Cass Ave, Argonne, IL 60439 USA
基金
美国国家科学基金会;
关键词
Thermal modeling; many-core processors; operating systems; high performance computing systems; NEURAL-NETWORKS; WORKLOAD;
D O I
10.1109/TPDS.2017.2732951
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Elevated temperatures limit the peak performance of systems because of frequent interventions by thermal throttling. Non-uniform thermal states across system nodes also cause performance variation within seemingly equivalent nodes leading to significant degradation of overall performance. In this paper we present a framework for creating a lightweight thermal prediction system suitable for run-time management decisions. We pursue two avenues to explore optimized lightweight thermal predictors. First, we use feature selection algorithms to improve the performance of previously designed machine learning methods. Second, we develop alternative methods using neural network and linear regression-based methods to perform a comprehensive comparative study of prediction methods. We show that our optimized models achieve improved performance with better prediction accuracy and lower overhead as compared with the Gaussian process model proposed previously. Specifically we present a reduced version of the Gaussian process model, a neural network-based model, and a linear regression-based model. Using the optimization methods, we are able to reduce the average prediction errors in the Gaussian process from 4: 2 degrees C to 2: 9 degrees C. We also show that the newly developed models using neural network and Lasso linear regression have average prediction errors of 2: 9 degrees C and 3: 8 degrees C respectively. The prediction overheads are 0.22, 0.097, and 0.026 ms per prediction for reduced Gaussian process, neural network, and Lasso linear regression models, respectively, compared with 0.57 ms per prediction for the previous Gaussian process model. We have implemented our proposed thermal prediction models on a two-node system configuration to help identify the optimal task placement. The task placement identified by the models reduces the average system temperature by up to 11: 9 degrees C without any performance degradation. Furthermore, these models respectively achieve 75, 82.5, and 74.17 percent success rates in correctly pointing to those task placements with better thermal response, compared with 72.5 percent success for the original model in achieving the same objective. Finally, we extended our analysis to a 16-node system and we were able to train models and execute them in real time to guide task migration and achieve on average 17 percent reduction in the overall system cooling power.
引用
收藏
页码:405 / 419
页数:15
相关论文
共 37 条
[1]  
Acun B., 2016, PAR DISTR PROC S WOR
[2]  
[Anonymous], 2009, SIGKDD Explorations, DOI DOI 10.1145/1656274.1656278
[3]   Thermal-Aware Scheduling in Green Data [J].
Chaudhry, Muhammad Tayyab ;
Ling, Teck Chaw ;
Manzoor, Atif ;
Hussain, Syed Asad ;
Kim, Jongwon .
ACM COMPUTING SURVEYS, 2015, 47 (03)
[4]  
Choi J, 2007, ISLPED'07: PROCEEDINGS OF THE 2007 INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN, P213, DOI 10.1145/1283780.1283826
[5]   Thermal Prediction and Adaptive Control Through Workload Phase Detection [J].
Cochran, Ryan ;
Reda, Sherief .
ACM TRANSACTIONS ON DESIGN AUTOMATION OF ELECTRONIC SYSTEMS, 2013, 18 (01)
[6]   Argonne applications for the IBM Blue Gene/Q, Mira [J].
Coghlan, S. ;
Kumaran, K. ;
Loy, R. M. ;
Messina, P. ;
Morozov, V. ;
Osborn, J. C. ;
Parker, S. ;
Riley, K. M. ;
Romero, N. A. ;
Williams, T. J. .
IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2013, 57 (1-2)
[7]   Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction [J].
Crone, Sven F. ;
Hibon, Michele ;
Nikolopoulos, Konstantinos .
INTERNATIONAL JOURNAL OF FORECASTING, 2011, 27 (03) :635-660
[8]  
Davison A.C., 2008, STAT MODELS
[9]   The Green500 List: Encouraging sustainable supercomputing [J].
Feng, Wu-Chun ;
Cameron, Kirk W. .
COMPUTER, 2007, 40 (12) :50-+
[10]  
Guyon I., 2003, INTRO VARIABLE FEATU