ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management

被引：108

作者：

Godoy, William F. ^{[1
]}

Podhorszki, Norbert ^{[1
]}

Wang, Ruonan ^{[1
]}

Atkins, Chuck ^{[2
]}

Eisenhauer, Greg ^{[3
]}

Gu, Junmin ^{[4
]}

Davis, Philip ^{[5
]}

Choi, Jong ^{[1
]}

Germaschewski, Kai ^{[6
,7
]}

Huck, Kevin ^{[8
]}

Huebl, Axel ^{[9
]}

Kim, Mark ^{[1
]}

Kress, James ^{[1
]}

Kurc, Tahsin ^{[10
]}

Liu, Qing ^{[11
]}

Logan, Jeremy ^{[1
]}

Mehta, Kshitij ^{[1
]}

Ostrouchov, George ^{[1
]}

Parashar, Manish ^{[5
]}

Poeschel, Franz ^{[9
]}

Pugmire, David ^{[1
]}

Suchyta, Eric ^{[1
]}

Takahashi, Keichi ^{[1
]}

Thompson, Nick ^{[1
]}

Tsutsumi, Seiji ^{[12
]}

Wan, Lipeng ^{[1
]}

Wolf, Matthew ^{[1
]}

Wu, Kesheng ^{[4
]}

Klasky, Scott ^{[1
]}

机构：

[1] Oak Ridge Natl Lab, Oak Ridge, TN 37830 USA

[2] Kitware Inc, Clifton Pk, NY USA

[3] Georgia Inst Technol, Sch Comp Sci, Atlanta, GA 30332 USA

[4] Lawrence Berkeley Natl Lab, Berkeley, CA USA

[5] Rutgers State Univ, Comp Sci Dept, New Brunswick, NJ USA

[6] Univ New Hampshire, Ctr Space Sci, Durham, NH 03824 USA

[7] Univ New Hampshire, Dept Phys, Durham, NH 03824 USA

[8] Univ Oregon, Eugene, OR 97403 USA

[9] Helmholtz Zentrum Dresden Rossendorf, Dresden, Germany

[10] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA

[11] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA

[12] Japan Aerosp Explorat Agcy, Sagamihara, Kanagawa, Japan

来源：

SOFTWAREX | 2020年 / 12卷

关键词：

High-performance computing (HPC); Scalable I/O; Luster GPFS file systems; Staging; RDMA; Data science; In-situ; Exascale computing; TABLE DATA SYSTEM; REDUCTION;

D O I：

10.1016/j.softx.2020.100561

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2 addresses scientific data management needs ranging from scalable I/O in supercomputers, to data analysis in personal computer and cloud systems. Version 2 introduces a unified application programming interface (API) that enables seamless data movement through files, wide-area-networks, and direct memory access, as well as high-level APIs for data analysis. The internal architecture provides a set of reusable and extendable components for managing data presentation and transport mechanisms for new applications. ADIOS 2 bindings are available in C++11, C, Fortran, Python, and Matlab and are currently used across different scientific communities. ADIOS 2 provides a communal framework to tackle data management challenges as we approach the exascale era of supercomputing. (C) 2020 The Authors. Published by Elsevier B.V.

引用

页数：9

共 50 条

[31] A high-performance batched matrix multiplication framework for GPUs under unbalanced input distribution
Wang, Ruimin
Yang, Zhiwei
Xu, Hao
Lu, Lu
JOURNAL OF SUPERCOMPUTING, 2022, 78 (02): : 1741 - 1758
[32] DEVELOPMENT OF HIGH-PERFORMANCE VARIABLE SHAPED ELECTRON-BEAM EXPOSURE SYSTEM.
Goto, Eichi
Soma, Takashi
Idesawa, Masanori
Miyauchi, Sakae
Tanaka, Kazumitsu
Research and Development in Japan Awarded the Okochi Memorial Prize, 1985, : 25 - 28
[33] High-performance milligram to multi-gram purification on a single flash system.
Bickler, JR
ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2002, 223 : B137 - B137
[34] A HIGH-PERFORMANCE DIGITAL DATA-TRANSMISSION SYSTEM
ULSTAD, MS
IEEE TRANSACTIONS ON COMMUNICATION TECHNOLOGY, 1968, CO16 (01): : 115 - &
[35] High-performance payload data handling system for Gaia
Portell, J.
Luri, X.
Garcia-Berro, E.
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2006, 42 (02) : 421 - 435
[36] Synchronous Parallel High-Performance Data Acquisition System
Ulbricht, M.
Wagner, J.
INSTRUMENTS AND EXPERIMENTAL TECHNIQUES, 2014, 57 (03) : 255 - 261
[37] High-performance computing system for electroencephalographic data analysis
Lazar, Zsolt I.
Heringa, Jouke R.
Papp, Istvan
Lazar, Alpar S.
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2010, 77 (03) : 311 - 312
[38] Synchronous parallel high-performance data acquisition system
M. Ulbricht
J. Wagner
Instruments and Experimental Techniques, 2014, 57 : 255 - 261
[39] System-Level Development and Verification Framework for High-Performance System Accelerator
Wang, Chen-Chieh
Wong, Ro-Pun
Lin, Jing-Wun
Chen, Chung-Ho
2009 INTERNATIONAL SYMPOSIUM ON VLSI DESIGN, AUTOMATION AND TEST (VLSI-DAT), PROCEEDINGS OF TECHNICAL PROGRAM, 2009, : 359 - 362
[40] Framework for high-performance data transfers optimization in large distributed systems
Cirstoiu, Catalin
Voicu, Ramiro
Tapus, Nicolae
PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON PARALLEL AND DISTRIBUTED COMPUTING, 2008, : 385 - 392

← 1 2 3 4 5 →