Early experiences in evaluating the parallel disk model with the ViC* implementation

被引:10
作者
Cormen, TH
Hirschl, M
机构
关键词
parallelism; data distribution; file systems; parallel disk model; input/output;
D O I
10.1016/S0167-8191(97)00014-8
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Although several algorithms have been developed for the Parallel Disk Model (PDM), few have been implemented, Consequently, little has been known about the accuracy of the PDM in measuring I/O time and total running time to perform an out-of-core computation. This paper analyzes timing results on multiple-disk platforms for two PDM algorithms, out-of-core radix sort and BMMC permutations, to determine the strengths and weaknesses of the PDM, The results indicate the following. First, good PDM algorithms are usually not I/O bound. Second, of the four PDM parameters, one (problem size) is a good indicator of I/O time and running time, one (memory size) is a good indicator of I/O time but not necessarily running time, and the other two (block size and number of disks) do not necessarily indicate either I/O or running time. Third, because PDM algorithms tend not to be I/O bound, using asynchronous I/O can reduce I/O wait times significantly, The software interface to the PDM is part of the ViC* run-time library. The interface is a set of wrappers that are designed to be both efficient and portable across several underlying file systems and target machines.
引用
收藏
页码:571 / 600
页数:30
相关论文
共 33 条
[1]   THE INPUT OUTPUT COMPLEXITY OF SORTING AND RELATED PROBLEMS [J].
AGGARWAL, A ;
VITTER, JS .
COMMUNICATIONS OF THE ACM, 1988, 31 (09) :1116-1127
[2]  
[Anonymous], P 40 IEEE COMP SOC I
[3]  
ARGE L, 1995, LECT NOTES COMPUTER, V979, P295
[4]  
ARGE L, 1995, 4 INT WORKSH ALG DAT, P334
[5]  
BARVE RD, 1996, P 8 ANN ACM S PAR AL, P109
[6]  
CHEN P, 1988, 88479 UCBCSD EECS U
[7]  
CHIANG YJ, 1995, PROCEEDINGS OF THE SIXTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P139
[8]  
Cormen T. H., 1990, INTRO ALGORITHMS
[9]   FAST PERMUTING ON DISK ARRAYS [J].
CORMEN, TH .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 1993, 17 (1-2) :41-57
[10]  
CORMEN TH, IN PRESS SIAM J COMP