Multi-Parameter Performance Modeling Based on Machine Learning with Basic Block Features

被引:0
|
作者
Hao, Meng [1 ]
Zhang, Weizhe [1 ,2 ]
Wang, Yiming [1 ]
Li, Dong [3 ]
Xia, Wen [2 ]
Wang, Hao [4 ]
Lou, Chen [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin, Peoples R China
[2] Peng Cheng Lab, Cyberspace Secur Res Ctr, Shenzhen, Peoples R China
[3] Univ Calif, Dept Elect Engn & Comp Sci, Merced, CA USA
[4] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
来源
2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019) | 2019年
基金
中国国家自然科学基金;
关键词
performance modeling; parallel application; basic block feature; machine learning;
D O I
10.1109/ISPA-BDCloud-SustainCom-SocialCom48970.2019.00054
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Considering the increasing complexity and scale of HPC architecture and software, the performance modeling of parallel applications on large-scale HPC platforms has become increasingly important. It plays an important role in many areas, such as performance analysis, job management, and resource estimation. In this work, we propose a multi-parameter performance modeling and prediction framework called MPerfPred, which utilizes basic block frequencies as features and uses machine learning algorithms to automatically construct multi-parameter performance models with high generalization ability. To reduce the prediction overhead, we propose some feature-filtering strategies to reduce the number of features in the training stage and build a serial program called BBF collector for each target application to quickly collect feature values in the prediction stage. We demonstrate the use of MPerfPred on the TianHe-2 supercomputer with six parallel applications. Results show that MPerfPred with SVR achieves better prediction than other input parameter-based modeling methods. The average prediction error and average standard deviation of prediction errors of MPerfPred are 8.42% and 6.09%, respectively. In the prediction stage, the average prediction overhead of MPerfPred is less than 0.13% of the total execution time.
引用
收藏
页码:316 / 323
页数:8
相关论文
共 50 条
  • [41] Multi-parameter optimization of machining impeller surface based on the on-machine measuring technique
    Wang, Gang
    Li, Wen-long
    Rao, Fan
    He, Zheng-rong
    Yin, Zhou-ping
    CHINESE JOURNAL OF AERONAUTICS, 2019, 32 (08) : 2000 - 2008
  • [42] Research on the Math Model of Multi-parameter of New Twisting Machine
    Zhang Zhiming
    Mei Shunqi
    Xu Qiao
    Zeng Lingzhou
    2009 ISECS INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT, VOL I, 2009, : 95 - 98
  • [43] Identification and Prediction of Nonlinear Multi-parameter Based on Least Squares Support Vector Machine
    Hou, Yuan-bin
    Li, Ning
    PROCEEDINGS OF THE 10TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA 2012), 2012, : 224 - 228
  • [44] A novel multi-parameter support vector machine for image classification
    Zhang, Ce
    Wang, Tiejun
    Atkinson, Peter M.
    Pan, Xin
    Li, Huapeng
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2015, 36 (07) : 1890 - 1906
  • [45] Model-based multi-parameter mapping
    Balbastre, Yael
    Brudfors, Mikael
    Azzarito, Michela
    Lambert, Christian
    Callaghan, Martina F.
    Ashburner, John
    MEDICAL IMAGE ANALYSIS, 2021, 73
  • [46] Multi-parameter Frequency Warping Based On LDA
    Liu, Gang
    Chu, Boce
    Fan, Ruchao
    2017 13TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (ICNC-FSKD), 2017, : 2710 - 2714
  • [47] Table based performance evaluation for HIPERLAN/2 systems - A multi-parameter design
    Svedman, P
    Bengtsson, M
    Ottersten, B
    VTC2004-SPRING: 2004 IEEE 59TH VEHICULAR TECHNOLOGY CONFERENCE, VOLS 1-5, PROCEEDINGS, 2004, : 966 - 969
  • [48] Towards enhancing the performance of multi-parameter patient monitors
    Vaijeyanthi, V.
    Vishnuprasad, K.
    Kumar, C. Santhosh
    Ramachandran, K. I.
    Gopinath, R.
    Kumar, A. Anand
    Yadav, Praveen Kumar
    HEALTHCARE TECHNOLOGY LETTERS, 2014, 1 (01) : 19 - 20
  • [49] A comparison of dimension reduction techniques for support vector machine modeling of multi-parameter manufacturing quality prediction
    Yun Bai
    Zhenzhong Sun
    Bo Zeng
    Jianyu Long
    Lin Li
    José Valente de Oliveira
    Chuan Li
    Journal of Intelligent Manufacturing, 2019, 30 : 2245 - 2256
  • [50] A comparison of dimension reduction techniques for support vector machine modeling of multi-parameter manufacturing quality prediction
    Bai, Yun
    Sun, Zhenzhong
    Zeng, Bo
    Long, Jianyu
    Li, Lin
    de Oliveira, Jose Valente
    Li, Chuan
    JOURNAL OF INTELLIGENT MANUFACTURING, 2019, 30 (05) : 2245 - 2256