Profiling hemodynamic application for parallel computing in the cloud

被引:1
作者
Ferretti, Marco [1 ]
Santangelo, Luigi [1 ]
机构
[1] Univ Pavia, Dept Elect Comp & Biomed Engn, Pavia, Italy
来源
2019 27TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP) | 2019年
关键词
Cloud Computing; HPC; Marconi; Google; Performance Prediction; Hemodynamic Applications; pLogP model; Cost modeling; PERFORMANCE; OPERATIONS;
D O I
10.1109/EMPDP.2019.8671622
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Porting to the cloud large scientific applications designed and optimized for a standard HPC facility does not always pay off, mainly because of the implied communication pattern. By profiling the applications, researchers can build a performance model, which is able to give insights about how the application will perform on the cloud. To validate this approach, we use a hemodynamic application that embeds both heavy computations and extensive communications with several collective operations to exchange data across all processes. We expect that this case instance is a model for other applications. Our approach is based on profiling and modeling, and builds an analytical model for the communication pattern of the chosen hemodynamic application. We collect data both on an on-premise HPC system and on the Google Cloud infrastructure, and assess the prediction based on the analytic model. The outcome suggests that the prediction consistently underestimates the actual execution time, but correctly guess the scalability, thus allowing to strike a good balance between performance and costs. Finally, we introduce a figure of merit to assess cost vs performance between cloud and on-premise implementation, and validate a first version of such a model.
引用
收藏
页码:41 / 50
页数:10
相关论文
共 12 条
[1]  
Auricchio Ferdinando, 2017, PARCO, P57
[2]  
Barchet-Estefanel L. A, 2004, LECT NOTES COMPUTER, V3241
[3]   Hybrid OpenMP-MPI parallelism: porting experiments from small to large clusters [J].
Ferretti, Marco ;
Santangelo, Luigi .
2018 26TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED, AND NETWORK-BASED PROCESSING (PDP 2018), 2018, :297-301
[4]  
Ferretti Marco, 2018, PBIO 2018, DOI [10.1145/3235830.3235837, DOI 10.1145/3235830.3235837]
[5]   Network Performance Aware MPI Collective Communication Operations in the Cloud [J].
Gong, Yifan ;
He, Bingsheng ;
Zhong, Jianlong .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (11) :3079-3089
[6]   An overview of the Trilinos Project [J].
Heroux, MA ;
Bartlett, RA ;
Howle, VE ;
Hoekstra, RJ ;
Hu, JJ ;
Kolda, TG ;
Lehoucq, RB ;
Long, KR ;
Pawlowski, RP ;
Phipps, ET ;
Salinger, AG ;
Thornquist, HK ;
Tuminaro, RS ;
Willenbring, JM ;
Williams, A ;
Stanley, KS .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2005, 31 (03) :397-423
[7]  
Kielmann T, 2000, INT PAR DISTR PROC S
[8]  
Marconi, 2018, NEW TIER 0 SYST
[9]  
Pjesivac-Grbovic J., 2005, Proceedings. 19th IEEE International Parallel and Distributed Processing Symposium
[10]   A framework for adaptive collective communications for heterogeneous hierarchical computing systems [J].
Steffenel, Luiz Angelo ;
Mounie, Gregory .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2008, 74 (06) :1082-1093