Analyzing the Parallel I/O Severity of MPI Applications

被引：5

作者：

Mendez, Sandra ^{[1
]}

Rexachs, Dolores ^{[2
]}

Luque, Emilio ^{[2
]}

机构：

[1] Leibniz Supercomp Ctr LRZ, High Performance Syst Div, Garching, Germany

[2] Univ Autonoma Barcelona, Comp Architecture & Operating Syst Dept, Barcelona, Spain

来源：

2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID) | 2017年

关键词：

HPC Systems; Parallel I/O; Parallel File System; I/O Severity; I/O system;

D O I：

10.1109/CCGRID.2017.45

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Performance evaluation of parallel applications plays an important role in High Performance Computing (HPC). This is also applied to parallel I/O performance evaluation, which requires understanding the I/O pattern of the application and having knowledge about the performance capacity of the HPC I/O system. In this paper, we present a methodology to evaluate the I/O performance of parallel applications based on the I/O severity degree. We define the I/O severity concept taking into account the I/O requirements of a parallel application, the mapping of I/O processes and the configuration of the I/O subsystem. Requirements are expressed in units denominated I/O phases, which are defined using the temporal and spatial pattern of different files of the application. Our approach is applied to the I/O kernels of scientific applications such as S3DIO, FLASH-IO and BT-IO on the SuperMUC supercomputer. Experimental results show that our methodology allows us to identify if a parallel application is limited by the I/O subsystem and identifying possible root causes of the I/O problems.

引用

页码：953 / 962

页数：10

共 13 条

[1]

[Anonymous], 2013, Tech. Rep.

[2]

Behzad B., 2015, IEEE CLUSTER 2015

[3]

Behzad Babak, 2015, P 10 PAR DAT STOR WO, P43, DOI 10.1145/2834976.2834977

[4]

Carns P, 2011, IEEE S MASS STOR SYS

[5]

Chen J. H., 2009, Computational Science and Discovery, V2, DOI 10.1088/1749-4699/2/1/015001

[6]

Choudhary A., 2008, SC 08

[7]

He Jun, 2013, P 22 INT S HIGHPERFO, P25, DOI 10.1145/2493123.2462909

[8]

Lang S, 2009, PROCEEDINGS OF THE CONFERENCE ON HIGH PERFORMANCE COMPUTING NETWORKING, STORAGE AND ANALYSIS

[9]

Luu Huong., 2015, P 24 ACM INT S HIGH, P33

[10]

Mendez S., 2012, 2012 IEEE International Conference on Cluster Computing Workshops (Cluster Workshops 2012), P7, DOI 10.1109/ClusterW.2012.37

← 1 2 →