Multi-Parameter Performance Modeling Based on Machine Learning with Basic Block Features

被引:0
|
作者
Hao, Meng [1 ]
Zhang, Weizhe [1 ,2 ]
Wang, Yiming [1 ]
Li, Dong [3 ]
Xia, Wen [2 ]
Wang, Hao [4 ]
Lou, Chen [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin, Peoples R China
[2] Peng Cheng Lab, Cyberspace Secur Res Ctr, Shenzhen, Peoples R China
[3] Univ Calif, Dept Elect Engn & Comp Sci, Merced, CA USA
[4] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
来源
2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019) | 2019年
基金
中国国家自然科学基金;
关键词
performance modeling; parallel application; basic block feature; machine learning;
D O I
10.1109/ISPA-BDCloud-SustainCom-SocialCom48970.2019.00054
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Considering the increasing complexity and scale of HPC architecture and software, the performance modeling of parallel applications on large-scale HPC platforms has become increasingly important. It plays an important role in many areas, such as performance analysis, job management, and resource estimation. In this work, we propose a multi-parameter performance modeling and prediction framework called MPerfPred, which utilizes basic block frequencies as features and uses machine learning algorithms to automatically construct multi-parameter performance models with high generalization ability. To reduce the prediction overhead, we propose some feature-filtering strategies to reduce the number of features in the training stage and build a serial program called BBF collector for each target application to quickly collect feature values in the prediction stage. We demonstrate the use of MPerfPred on the TianHe-2 supercomputer with six parallel applications. Results show that MPerfPred with SVR achieves better prediction than other input parameter-based modeling methods. The average prediction error and average standard deviation of prediction errors of MPerfPred are 8.42% and 6.09%, respectively. In the prediction stage, the average prediction overhead of MPerfPred is less than 0.13% of the total execution time.
引用
收藏
页码:316 / 323
页数:8
相关论文
共 50 条
  • [31] A multi-parameter homogenization study for modeling elastic masonry
    Cecchi, A
    Sab, K
    EUROPEAN JOURNAL OF MECHANICS A-SOLIDS, 2002, 21 (02) : 249 - 268
  • [32] Automated Machine Learning Strategies for Multi-Parameter Optimisation of a Caesium-Based Portable Zero-Field Magnetometer
    Dawson, Rach
    O'Dwyer, Carolyn
    Irwin, Edward
    Mrozowski, Marcin S. S.
    Hunter, Dominic
    Ingleby, Stuart
    Riis, Erling
    Griffin, Paul F. F.
    SENSORS, 2023, 23 (08)
  • [33] Blockwise matrix multi-splitting multi-parameter block relaxation methods
    Evans, DJ
    Bai, ZZ
    INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 1997, 64 (1-2) : 103 - 118
  • [34] Assessment of HCV infection stage as recent or chronic using multi-parameter analysis and machine learning
    Baykal, Pelin Icer
    Artyomenko, Alexander
    Ramachandran, Sumathi
    Khudyakov, Yury
    Zelikovsky, Alex
    Skums, Pavel
    2017 IEEE 7TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL ADVANCES IN BIO AND MEDICAL SCIENCES (ICCABS), 2017,
  • [35] A Multi-Parameter Optimization Method for Electromagnetic Characteristics Fitting Based on Deep Learning
    Hao, Jiaxing
    Yang, Sen
    Gao, Hongmin
    APPLIED SCIENCES-BASEL, 2024, 14 (22):
  • [36] A Deep Learning-Based Approach for the Identification of a Multi-Parameter BWBN Model
    Li, Zele
    Noori, Mohammad
    Wan, Chunfeng
    Yu, Bo
    Wang, Bochen
    Altabey, Wael A.
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [37] ORCANet: Differentiable multi-parameter learning for crowd simulation
    Zhang, Jiawen
    Li, Chen
    Wang, Changbo
    He, Gaoqi
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2023, 34 (01)
  • [38] Response and multi-parameter determination of microresistivity scanning imaging logging while drilling in oil-based drilling fluid using numerical modeling and machine learning
    Gao, Jianshen
    Wu, Shixun
    Ma, Yani
    Jiang, Liming
    Shi, Juncheng
    GEOENERGY SCIENCE AND ENGINEERING, 2025, 247
  • [39] Multi-parameter fusion driver fatigue detection method based on facial fatigue features
    Du, Xuejing
    Yu, Chengyin
    Sun, Tianyi
    JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY, 2024, 32 (09) : 676 - 690
  • [40] Multi-parameter optimization of machining impeller surface based on the on-machine measuring technique
    Gang WANG
    Wen-long LI
    Fan RAO
    Zheng-rong HE
    Zhou-ping YIN
    Chinese Journal of Aeronautics, 2019, 32 (08) : 2000 - 2008