Multi-Parameter Performance Modeling Based on Machine Learning with Basic Block Features

被引:0
|
作者
Hao, Meng [1 ]
Zhang, Weizhe [1 ,2 ]
Wang, Yiming [1 ]
Li, Dong [3 ]
Xia, Wen [2 ]
Wang, Hao [4 ]
Lou, Chen [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin, Peoples R China
[2] Peng Cheng Lab, Cyberspace Secur Res Ctr, Shenzhen, Peoples R China
[3] Univ Calif, Dept Elect Engn & Comp Sci, Merced, CA USA
[4] Norwegian Univ Sci & Technol, Dept Comp Sci, Trondheim, Norway
来源
2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019) | 2019年
基金
中国国家自然科学基金;
关键词
performance modeling; parallel application; basic block feature; machine learning;
D O I
10.1109/ISPA-BDCloud-SustainCom-SocialCom48970.2019.00054
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Considering the increasing complexity and scale of HPC architecture and software, the performance modeling of parallel applications on large-scale HPC platforms has become increasingly important. It plays an important role in many areas, such as performance analysis, job management, and resource estimation. In this work, we propose a multi-parameter performance modeling and prediction framework called MPerfPred, which utilizes basic block frequencies as features and uses machine learning algorithms to automatically construct multi-parameter performance models with high generalization ability. To reduce the prediction overhead, we propose some feature-filtering strategies to reduce the number of features in the training stage and build a serial program called BBF collector for each target application to quickly collect feature values in the prediction stage. We demonstrate the use of MPerfPred on the TianHe-2 supercomputer with six parallel applications. Results show that MPerfPred with SVR achieves better prediction than other input parameter-based modeling methods. The average prediction error and average standard deviation of prediction errors of MPerfPred are 8.42% and 6.09%, respectively. In the prediction stage, the average prediction overhead of MPerfPred is less than 0.13% of the total execution time.
引用
收藏
页码:316 / 323
页数:8
相关论文
共 50 条
  • [21] Research on multi-parameter fusion non-invasive blood glucose detection method based on machine learning
    LI, J. -j.
    Qu, Z. -p.
    Wang, Y. -w.
    Guo, J.
    EUROPEAN REVIEW FOR MEDICAL AND PHARMACOLOGICAL SCIENCES, 2022, 26 (17) : 6040 - 6049
  • [22] Calibration method of multi-parameter compensation for optical dissolved oxygen sensor in seawater based on machine learning algorithm
    Zhang, Ying
    Zhang, Yingying
    Yuan, Da
    Zhang, Yunyan
    Wu, Bingwei
    Feng, Xiandong
    DEEP-SEA RESEARCH PART I-OCEANOGRAPHIC RESEARCH PAPERS, 2022, 188
  • [23] Multi-Parameter Structural Topology Optimization Method Based On Deep Learning
    Chu, Zunkang
    Yu, Haiyan
    Gao, Ze
    Rao, Weixiong
    Tongji Daxue Xuebao/Journal of Tongji University, 2024, 52 : 20 - 28
  • [24] Improving Performance of Current Sensor Chip Based on Multi-Parameter Compensation
    Woo, Goeun
    Park, Sangbo
    Kim, Hyungwon
    2023 20TH INTERNATIONAL SOC DESIGN CONFERENCE, ISOCC, 2023, : 293 - 294
  • [25] A multi-parameter fitting method based on matrix transformation for device aging modeling
    Sang, Qianqian
    Yang, Xinhuan
    Zhang, Jianyu
    Wang, Chuanzheng
    Yu, Mingyan
    Zhao, Yuanfu
    MICROELECTRONICS RELIABILITY, 2023, 142
  • [26] Modeling of a multi-parameter chaotic optoelectronic oscillator based on the Fourier neural operator
    Feng, J. I. A. C. H. E. N. G.
    Jiang, L. I. N.
    Yan, I. A. N. S. H. A. N.
    Yi, A. N. L. I. N.
    LI, Song-sui
    Pan, W. E., I
    Luo, B. I. N.
    Pan, Y. A. N.
    Xu, B. I. N. G. J. I. E.
    Yi, L. I. L. I. N.
    Wang, L. O. N. G. S. H. E. N. G.
    Wang, A. N. B. A. N. G.
    Wang, Y. U. N. C. A., I
    OPTICS EXPRESS, 2022, 30 (25) : 44798 - 44813
  • [27] A multi-parameter homogenization study for modeling elastic masonry
    Cecchi, Antonella
    Sab, Karam
    Cecchi, A. (cecchi@brezza.iuav.it), 1600, Elsevier Masson SAS (21):
  • [28] A multi-parameter land data set for regional modeling
    Thames, P
    Maslanik, J
    Oleson, K
    Emery, W
    IGARSS '96 - 1996 INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM: REMOTE SENSING FOR A SUSTAINABLE FUTURE, VOLS I - IV, 1996, : 192 - 194
  • [29] Multi-parameter aerodynamic modeling for aeroelastic coupling in turbomachinery
    Tran, D. -M.
    JOURNAL OF FLUIDS AND STRUCTURES, 2009, 25 (03) : 519 - 534
  • [30] Research on the Multi-Parameter Modeling of Submarine Sediment Prediction
    Luo, Zhonghui
    Xiao, Qijun
    Wu, Junlan
    PROGRESS IN MECHATRONICS AND INFORMATION TECHNOLOGY, PTS 1 AND 2, 2014, 462-463 : 13 - +