Predicting Faults in High Performance Computing Systems: An In-Depth Survey of the State-of-the-Practice

被引:24
作者
Jauk, David [1 ]
Yang, Dai [2 ]
Schulz, Martin [2 ]
机构
[1] Tech Univ Munich, Dept Informat, Garching, Germany
[2] Tech Univ Munich, Chair Comp Architecture & Parallel Syst, Garching, Germany
来源
PROCEEDINGS OF SC19: THE INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS | 2019年
关键词
High Performance Computing; Fault Prediction; Resillience; Exascale Computing; BAYESIAN SERIAL REVISION; FAILURE PREDICTION; CLUSTER;
D O I
10.1145/3295500.3356185
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
As we near exascale, resilience remains a major technical hurdle. Any technique with the goal of achieving resilience suffers from having to be reactive, as failures can appear at any time. A wide body of research aims at predicting failures, i.e., forecasting failures so that evasive actions can be taken while the system is still fully functional, which has the benefit of giving insight into the global system state. This research area has grown very diverse with a large number of approaches, yet is currently poorly classified, making it hard to understand the impact and coverage of existing work. In this paper, we perform an extensive survey of existing literature in failure prediction by analyzing and comparing more than 30 different failure prediction approaches. We develop a taxonomy, which aids in categorizing the methods, and we show how this can help us to understand the state-of-the-practice of this field and to identify opportunities, gaps as well as future work.
引用
收藏
页数:13
相关论文
共 81 条
[61]   A Survey of Online Failure Prediction Methods [J].
Salfner, Felix ;
Lenk, Maren ;
Malek, Miroslaw .
ACM COMPUTING SURVEYS, 2010, 42 (03)
[62]  
Schroeder B, 2007, USENIX ASSOCIATION PROCEEDINGS OF THE 5TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES ( FAST '07), P1
[63]   A Large-Scale Study of Failures in High-Performance Computing Systems [J].
Schroeder, Bianca ;
Gibson, Garth A. .
IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2010, 7 (04) :337-350
[64]  
Schroeder B, 2009, PERF E R SI, V37, P193
[65]   Towards operator-less data centers through data-driven, predictive, proactive autonomics [J].
Sirbu, Alina ;
Babaoglu, Ozalp .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2016, 19 (02) :865-878
[66]   Predicting Scheduling Failures in the Cloud: A Case Study with Google Clusters and Hadoop on Amazon EMR [J].
Soualhia, Mbarka ;
Khomh, Foutse ;
Tahar, Sofiene .
2015 IEEE 17TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2015 IEEE 7TH INTERNATIONAL SYMPOSIUM ON CYBERSPACE SAFETY AND SECURITY, AND 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS), 2015, :58-65
[67]  
Sridharan V, 2013, INT CONF HIGH PERFOR
[68]  
Taerat N., 2010, 2010 International Symposium on Parallel and Distributed Processing with Applications (ISPA 2010), P491, DOI 10.1109/ISPA.2010.84
[69]  
Thompson J., 2010, 2010 International Conference on Dependable Systems and Networks Workshops (DSN-W), P8, DOI 10.1109/DSNW.2010.5542626
[70]  
Tin Kam Ho, 1995, Proceedings of the Third International Conference on Document Analysis and Recognition, P278, DOI 10.1109/ICDAR.1995.598994