Tight bounds for prefetching and buffer management algorithms for parallel I/O systems

被引:9
|
作者
Varman, PJ
Verma, RM
机构
[1] Rice Univ, Dept Elect & Comp Engn, Houston, TX 77005 USA
[2] Univ Houston, Dept Comp Sci, Houston, TX 77204 USA
基金
美国国家科学基金会;
关键词
parallel I/O; algorithms; prefetching; caching; buffer management; competitive ratio; multiple-disk systems; external memory;
D O I
10.1109/71.819948
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The I/O performance of applications in multiple-disk systems can be improved by overlapping disk accesses. This requires the use of appropriate prefetching and buffer management algorithms that ensure the most useful blocks are accessed and retained in the buffer. in this paper, we answer several fundamental questions on prefetching and buffer management for distributed-buffer parallel I/O systems. First, we derive and prove the optimality of an algorithm, P-min, that minimizes the number of parallel I/Os. Second, we analyze P-con, an algorithm that always matches its replacement decisions with those of the well-known demand-paged MIN algorithm. We show that P-con can become fully sequential in the worst case. Third, we investigate the behavior of on-line algorithms for multiple-disk prefetching and buffer management. We define and analyze P-Iru, a parallel version of the traditional LRU buffer management algorithm. Unexpectedly, we find that the competitive ratio of P-Iru is independent of the number of disks. Finally, we present the practical performance of these algorithms on randomly generated reference strings. These results confirm the conclusions derived from the analysis on worst case inputs.
引用
收藏
页码:1262 / 1275
页数:14
相关论文
共 50 条
  • [1] Tight bounds for prefetching and buffer management algorithms for parallel I/O systems
    IEEE
    不详
    不详
    IEEE Trans Parallel Distrib Syst, 12 (1262-1275):
  • [2] Randomized parallel prefetching and buffer management
    Varman, PJ
    PARALLEL AND DISTRIBUTED PROCESSING, 1998, 1388 : 363 - 372
  • [3] Competitive parallel disk prefetching and buffer management
    Barve, R
    Kallahalla, M
    Varman, PJ
    Vitter, JS
    JOURNAL OF ALGORITHMS-COGNITION INFORMATICS AND LOGIC, 2000, 36 (02): : 152 - 181
  • [4] PRE-BUD: Prefetching for Energy-Efficient Parallel I/O Systems with Buffer Disks
    Manzanares, Adam
    Qin, Xiao
    Ruan, Xiaojun
    Yin, Shu
    ACM TRANSACTIONS ON STORAGE, 2011, 7 (01)
  • [5] Almost Tight Bounds for Reordering Buffer Management
    Adamaszek, Anna
    Czumaj, Artur
    Englert, Matthias
    Raecke, Harald
    STOC 11: PROCEEDINGS OF THE 43RD ACM SYMPOSIUM ON THEORY OF COMPUTING, 2011, : 607 - 616
  • [6] ALMOST TIGHT BOUNDS FOR REORDERING BUFFER MANAGEMENT
    Adamaszek, Anna
    Czumaj, Artur
    Englert, Matthias
    Raecke, Harald
    SIAM JOURNAL ON COMPUTING, 2022, 51 (03) : 701 - 722
  • [7] Analysis of simple randomized buffer management for parallel I/O
    Kallahalla, M
    Varman, PJ
    INFORMATION PROCESSING LETTERS, 2004, 90 (01) : 47 - 52
  • [8] A trace-driven analysis of parallel prefetching algorithms for parallel and distributed systems
    Bin, Cai
    Hu, Diqing
    Xie, Changsheng
    EIGHTH INTERNATIONAL CONFERENCE ON HIGH-PERFORMANCE COMPUTING IN ASIA-PACIFIC REGION, PROCEEDINGS, 2005, : 273 - 280
  • [9] PC-OPT: Optimal offline prefetching and caching for parallel I/O systems
    Kallahalla, M
    Varman, PJ
    IEEE TRANSACTIONS ON COMPUTERS, 2002, 51 (11) : 1333 - 1344
  • [10] Parallel I/O Prefetching Using MPI File Caching and I/O Signatures
    Byna, Surendra
    Chen, Yong
    Sun, Xian-He
    Thakur, Rajeev
    Gropp, William
    INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2008, : 350 - +