ConfProf: White-Box Performance Profiling of Configuration Options

被引:18
作者
Han, Xue [1 ]
Yu, Tingting [2 ]
Pradel, Michael [3 ]
机构
[1] Univ Southern Indiana, Evansville, IN 47712 USA
[2] Univ Kentucky, Lexington, KY 40506 USA
[3] Univ Stuttgart, Stuttgart, Germany
来源
PROCEEDINGS OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '21) | 2021年
基金
美国国家科学基金会; 欧洲研究理事会;
关键词
Performance Profiling; Software Performance;
D O I
10.1145/3427921.3450255
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Modern software systems are highly customizable through configuration options. The sheer size of the configuration space makes it challenging to understand the performance influence of individual configuration options and their interactions under a specific usage scenario. Software with poor performance may lead to low system throughput and long response time. This paper presents ConfProf, a white-box performance profiling technique with a focus on configuration options. ConfProf helps developers understand how configuration options and their interactions influence the performance of a software system. The approach combines dynamic program analysis, machine learning, and feedback-directed configuration sampling to profile the program execution and analyze the performance influence of configuration options. Compared to existing approaches, ConfProf uses a white-box approach combined with machine learning to rank performance-influencing configuration options from execution traces. We evaluate the approach with 13 scenarios of four real-world, highly-configurable software systems. The results show that ConfProf ranks performance-influencing configuration options with high accuracy and outperform a state of the art technique.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 35 条
[1]  
Anderson Paul, 2008, CROSSTALK J DEFENSE, V21, P18
[2]  
[Anonymous], 2013, Proceedings of the 2013 International Symposium on Software Testing and Analysis, DOI DOI 10.1145/2483760.2483784
[3]  
Attariyan M., 2010, 9 USENIX S OP SYST D
[4]  
Attariyan Mona, 2012, P 10 USENIX C OPERAT, P307
[5]  
Bailey DH, 2005, LECT NOTES COMPUT SC, V3648, P185
[6]   WISE: Automated Test Generation for Worst-Case Complexity [J].
Burnim, Jacob ;
Juvekar, Sudeep ;
Sen, Koushik .
2009 31ST INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, PROCEEDINGS, 2009, :463-473
[7]   Root mean square error (RMSE) or mean absolute error (MAE)? - Arguments against avoiding RMSE in the literature [J].
Chai, T. ;
Draxler, R. R. .
GEOSCIENTIFIC MODEL DEVELOPMENT, 2014, 7 (03) :1247-1250
[8]   Synthesizing Programs That Expose Performance Bottlenecks [J].
Della Toffola, Luca ;
Pradel, Michael ;
Gross, Thomas R. .
PROCEEDINGS OF THE 2018 INTERNATIONAL SYMPOSIUM ON CODE GENERATION AND OPTIMIZATION (CGO'18), 2018, :314-326
[9]   Directed Test Generation to Detect Loop Inefficiencies [J].
Dhok, Monika ;
Ramanathan, Murali Krishna .
FSE'16: PROCEEDINGS OF THE 2016 24TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON FOUNDATIONS OF SOFTWARE ENGINEERING, 2016, :895-907
[10]  
Guo JM, 2013, IEEE INT CONF AUTOM, P301, DOI 10.1109/ASE.2013.6693089