Multi-Parameter Performance Modeling Based on Machine Learning with Basic Block Features

被引:0
|
作者
Hao, Meng [1 ]
Zhang, Weizhe [1 ,2 ]
Wang, Yiming [1 ]
Li, Dong [3 ]
Xia, Wen [2 ]
Wang, Hao [4 ]
Lou, Chen [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin, Peoples R China
[2] Peng Cheng Lab, Cyberspace Secur Res Ctr, Shenzhen, Peoples R China
[3] Univ Calif, Dept Elect Engn & Comp Sci, Merced, CA USA
[4] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
来源
2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019) | 2019年
基金
中国国家自然科学基金;
关键词
performance modeling; parallel application; basic block feature; machine learning;
D O I
10.1109/ISPA-BDCloud-SustainCom-SocialCom48970.2019.00054
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Considering the increasing complexity and scale of HPC architecture and software, the performance modeling of parallel applications on large-scale HPC platforms has become increasingly important. It plays an important role in many areas, such as performance analysis, job management, and resource estimation. In this work, we propose a multi-parameter performance modeling and prediction framework called MPerfPred, which utilizes basic block frequencies as features and uses machine learning algorithms to automatically construct multi-parameter performance models with high generalization ability. To reduce the prediction overhead, we propose some feature-filtering strategies to reduce the number of features in the training stage and build a serial program called BBF collector for each target application to quickly collect feature values in the prediction stage. We demonstrate the use of MPerfPred on the TianHe-2 supercomputer with six parallel applications. Results show that MPerfPred with SVR achieves better prediction than other input parameter-based modeling methods. The average prediction error and average standard deviation of prediction errors of MPerfPred are 8.42% and 6.09%, respectively. In the prediction stage, the average prediction overhead of MPerfPred is less than 0.13% of the total execution time.
引用
收藏
页码:316 / 323
页数:8
相关论文
共 50 条
  • [11] A nomogram for predicting CRT response based on multi-parameter features
    Lou, Yuxuan
    Hua, Yang
    Yang, Jiaming
    Shi, Jing
    Jiang, Lei
    Yang, Yang
    BMC CARDIOVASCULAR DISORDERS, 2024, 24 (01):
  • [12] Combining the Multiple Features for Improving the Performance of Multi-Parameter Patient Monitor
    Bose, S. Sanjanaa
    Kumar, C. Santhosh
    2019 5TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING & COMMUNICATION SYSTEMS (ICACCS), 2019, : 647 - 651
  • [13] MULTI-PARAMETER CHECKING OF THE QUALITATIVE FEATURES OF PAPER
    VAKULYUK, YA
    KONOVAL, VA
    MEASUREMENT TECHNIQUES USSR, 1982, 25 (02): : 182 - 184
  • [14] MAGInet based on deep learning for magnetic multi-parameter inversion
    Wen, Wudi
    Li, Yi
    Liu, Zhongle
    AIP ADVANCES, 2025, 15 (01)
  • [15] Design of multi-parameter photonic devices using machine learning pattern recognition
    Melati, Daniele
    Grinberg, Yuri
    Dezfouli, Mohsen Kamandar
    Schmid, Jens H.
    Cheben, Pavel
    Janz, Siegfried
    Cheriton, Ross
    Sanchez-Postigo, Alejandro
    Pond, James
    Niegemann, Jens
    Reid, Adam
    Xu, Dan-Xia
    INTEGRATED PHOTONICS PLATFORMS: FUNDAMENTAL RESEARCH, MANUFACTURING AND APPLICATIONS, 2020, 11364
  • [16] Areal-time seismic intensity prediction model based on multi-parameter driven machine learning
    Ding YiTian
    Hu JinJun
    Zhang Hui
    Jin ChaoYue
    Hu Lei
    Wang ZhongWei
    Tang Chao
    CHINESE JOURNAL OF GEOPHYSICS-CHINESE EDITION, 2023, 66 (07): : 2920 - 2932
  • [17] Modeling of the multi-parameter Bragg grating sensor
    Lawrence, CM
    Nelson, DV
    Makino, A
    Udd, E
    THIRD PACIFIC NORTHWEST FIBER OPTIC SENSOR WORKSHOP, 1997, 3180 : 42 - 49
  • [18] Multi-Parameter Modeling with ANN for Antenna Design
    Wu, Zhuochun
    Yang, Yang
    Yao, Zhixin
    2018 IEEE ANTENNAS AND PROPAGATION SOCIETY INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION & USNC/URSI NATIONAL RADIO SCIENCE MEETING, 2018, : 2381 - 2382
  • [19] Automatic Multi-Parameter Performance Modeling of HPC Applications on a New Sunway Supercomputer
    Zhang, Yilian
    Liu, Yao
    Jiao, Penglong
    Zhou, Yiping
    Wei, Tongquan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (11) : 2965 - 2977
  • [20] Multi-parameter classification and quantification of R-134a condensation using machine learning
    Silva Jr, Luiz H.
    Barbosa Jr, Jader R.
    da Silva, Alexandre K.
    APPLIED THERMAL ENGINEERING, 2023, 231