Noncontiguous I/O accesses through MPI-IO

被引:27
作者
Ching, A [1 ]
Choudhary, A [1 ]
Coloma, K [1 ]
Liao, WK [1 ]
Ross, R [1 ]
Gropp, W [1 ]
机构
[1] Northwestern Univ, Ctr Parallel & Distributed Comp, Evanston, IL 60208 USA
来源
CCGRID 2003: 3RD IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, PROCEEDINGS | 2003年
关键词
D O I
10.1109/CCGRID.2003.1199358
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
I/O performance remains a weakness of parallel computing systems today. While this weakness is partly attributed to rapid advances in other system components, I/O interfaces available to programmers and the I/O methods supported by file systems have traditionally not matched efficiently with the types of I/O operations that scientific applications perform, particularly noncontiguous accesses. The MPI-IO interface allows for rich descriptions of the I/O patterns desired for scientific applications and implementations such as ROMIO have taken advantage of this ability while remaining limited by underlying file system methods. A method of noncontiguous data access, list I/O, was recently implemented in the Parallel Virtual File System (PVFS). We implement support for this interface in the ROMIO MPI-IO implementation. Through a suite of noncontiguous I/O tests we compared ROMIO list I/O to current methods of ROMIO noncontiguous access and found that the list I/O interface provides performance benefits in many noncontiguous cases.
引用
收藏
页码:104 / 111
页数:8
相关论文
共 19 条
[1]  
BAER T, 2002, CUG SUMMIT 2002
[2]  
BAYLOR SJ, 1995, P IPPS 95 WORKSH INP, P16
[3]  
Bordawekar R., 1993, Proceedings SUPERCOMPUTING '93, P452, DOI 10.1145/169627.169782
[4]  
Carns PH, 2000, USENIX ASSOCIATION PROCEEDINGS OF THE 4TH ANNUAL LINUX SHOWCASE AND CONFERENCE, ATLANTA, P317
[5]  
CHING A, 2002, P 2002 IEEE INT C CL
[6]  
CRANDALL PE, 1995, P SUP 95 SAN DIEG CA
[7]  
DELROSARIO JM, 1993, P IPPS 93 WORKSH INP, P31
[8]   Flash: An adaptive mesh hydrodynamics code for modeling astrophysical thermonuclear flashes [J].
Fryxell, B ;
Olson, K ;
Ricker, P ;
Timmes, FX ;
Zingale, M ;
Lamb, DQ ;
MacNeice, P ;
Rosner, R ;
Truran, JW ;
Tufo, H .
ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2000, 131 (01) :273-334
[9]  
JONES T, 1996, P 5 NASA GODD C MASS, P1
[10]  
Kotz D., 1994, Proceedings of the First USENIX Symposium on Operating Systems Design and Implementation (OSDI), P61