Efficient I/O and Storage of Adaptive-Resolution Data

被引:17
作者
Kumar, Sidharth [1 ]
Edwards, John [1 ]
Bremer, Peer-Timo [1 ,3 ]
Knoll, Aaron [1 ]
Christensen, Cameron [1 ]
Vishwanath, Venkatram [2 ]
Carns, Philip [2 ]
Schmidt, John A. [1 ]
Pascucci, Valerio [1 ]
机构
[1] Univ Utah, Sci Comp & Imaging Inst, Salt Lake City, UT 84112 USA
[2] Argonne Natl Lab, Argonne, IL 60439 USA
[3] Lawrence Livermore Natl Lab, Livermore, CA USA
来源
SC14: INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS | 2014年
关键词
D O I
10.1109/SC.2014.39
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present an efficient, flexible, adaptive-resolution I/O framework that is suitable for both uniform and Adaptive Mesh Refinement (AMR) simulations. In an AMR setting, current solutions typically represent each resolution level as an independent grid which often results in inefficient storage and performance. Our technique coalesces domain data into a unified, multiresolution representation with fast, spatially aggregated I/O. Furthermore, our framework easily extends to importance-driven storage of uniform grids, for example, by storing regions of interest at full resolution and nonessential regions at lower resolution for visualization or analysis. Our framework, which is an extension of the PIDX framework, achieves state of the art disk usage and I/O performance regardless of resolution of the data, regions of interest, and the number of processes that generated the data. We demonstrate the scalability and efficiency of our framework using the Uintah and S3D large-scale combustion codes on the Mira and Edison supercomputers.
引用
收藏
页码:413 / 423
页数:11
相关论文
共 26 条
  • [1] [Anonymous], HIGH PERFORMANCE VIS
  • [2] [Anonymous], P SC13 INT C HIGH PE
  • [3] Chen J. H., 2009, Computational Science and Discovery, V2, DOI 10.1088/1749-4699/2/1/015001
  • [4] Colella P., 2000, TECH REP
  • [5] Flash: An adaptive mesh hydrodynamics code for modeling astrophysical thermonuclear flashes
    Fryxell, B
    Olson, K
    Ricker, P
    Timmes, FX
    Zingale, M
    Lamb, DQ
    MacNeice, P
    Rosner, R
    Truran, JW
    Tufo, H
    [J]. ASTROPHYSICAL JOURNAL SUPPLEMENT SERIES, 2000, 131 (01) : 273 - 334
  • [6] Uintah: A massively parallel problem solving environment
    Germain, JDDS
    McCorquodale, J
    Parker, SG
    Johnson, CR
    [J]. NINTH INTERNATIONAL SYMPOSIUM ON HIGH-PERFORMANCE DISTRIBUTED COMPUTING, PROCEEDINGS, 2000, : 33 - 41
  • [7] Kui Gao, 2009, Proceedings of the 2009 International Conference on Parallel Processing (ICPP 2009), P470, DOI 10.1109/ICPP.2009.68
  • [8] Kumar Sidharth, 2014, Supercomputing. 29th International Conference, ISC 2014. Proceedings: LNCS 8488, P314, DOI 10.1007/978-3-319-07518-1_20
  • [9] Kumar S., 2010, P 2010 PET DAT STOR
  • [10] Kumar S. R. S., 2012, International Journal of Advanced Life Sciences (IJALS), V1, P1