ADIOS 2: The Adaptable Input Output System. A framework for high-performance data management

被引：108

作者：

Godoy, William F. ^{[1
]}

Podhorszki, Norbert ^{[1
]}

Wang, Ruonan ^{[1
]}

Atkins, Chuck ^{[2
]}

Eisenhauer, Greg ^{[3
]}

Gu, Junmin ^{[4
]}

Davis, Philip ^{[5
]}

Choi, Jong ^{[1
]}

Germaschewski, Kai ^{[6
,7
]}

Huck, Kevin ^{[8
]}

Huebl, Axel ^{[9
]}

Kim, Mark ^{[1
]}

Kress, James ^{[1
]}

Kurc, Tahsin ^{[10
]}

Liu, Qing ^{[11
]}

Logan, Jeremy ^{[1
]}

Mehta, Kshitij ^{[1
]}

Ostrouchov, George ^{[1
]}

Parashar, Manish ^{[5
]}

Poeschel, Franz ^{[9
]}

Pugmire, David ^{[1
]}

Suchyta, Eric ^{[1
]}

Takahashi, Keichi ^{[1
]}

Thompson, Nick ^{[1
]}

Tsutsumi, Seiji ^{[12
]}

Wan, Lipeng ^{[1
]}

Wolf, Matthew ^{[1
]}

Wu, Kesheng ^{[4
]}

Klasky, Scott ^{[1
]}

机构：

[1] Oak Ridge Natl Lab, Oak Ridge, TN 37830 USA

[2] Kitware Inc, Clifton Pk, NY USA

[3] Georgia Inst Technol, Sch Comp Sci, Atlanta, GA 30332 USA

[4] Lawrence Berkeley Natl Lab, Berkeley, CA USA

[5] Rutgers State Univ, Comp Sci Dept, New Brunswick, NJ USA

[6] Univ New Hampshire, Ctr Space Sci, Durham, NH 03824 USA

[7] Univ New Hampshire, Dept Phys, Durham, NH 03824 USA

[8] Univ Oregon, Eugene, OR 97403 USA

[9] Helmholtz Zentrum Dresden Rossendorf, Dresden, Germany

[10] SUNY Stony Brook, Dept Biomed Informat, Stony Brook, NY 11794 USA

[11] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA

[12] Japan Aerosp Explorat Agcy, Sagamihara, Kanagawa, Japan

来源：

SOFTWAREX | 2020年 / 12卷

关键词：

High-performance computing (HPC); Scalable I/O; Luster GPFS file systems; Staging; RDMA; Data science; In-situ; Exascale computing; TABLE DATA SYSTEM; REDUCTION;

D O I：

10.1016/j.softx.2020.100561

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present ADIOS 2, the latest version of the Adaptable Input Output (I/O) System. ADIOS 2 addresses scientific data management needs ranging from scalable I/O in supercomputers, to data analysis in personal computer and cloud systems. Version 2 introduces a unified application programming interface (API) that enables seamless data movement through files, wide-area-networks, and direct memory access, as well as high-level APIs for data analysis. The internal architecture provides a set of reusable and extendable components for managing data presentation and transport mechanisms for new applications. ADIOS 2 bindings are available in C++11, C, Fortran, Python, and Matlab and are currently used across different scientific communities. ADIOS 2 provides a communal framework to tackle data management challenges as we approach the exascale era of supercomputing. (C) 2020 The Authors. Published by Elsevier B.V.

引用

页数：9

共 50 条

[41] Anagram - A modular Java framework for high-performance scientific data servers
Ctr. Ocean-Land-Atmosphere Studs.
不详
AMS; AGU, 1600, 1023-1028 (2004):
[42] A high-performance intelligent integrated data services system in data grid
Huang, B
Peng, XN
Xiao, N
Liu, B
GRID AND COOPERATIVE COMPUTING, PT 1, 2004, 3032 : 262 - 265
[43] Data management and transfer in high-performance computational grid environments
Allcock, B
Bester, J
Bresnahan, J
Chervenak, AL
Foster, I
Kesselman, C
Meder, S
Nefedova, V
Quesnel, D
Tuecke, S
PARALLEL COMPUTING, 2002, 28 (05) : 749 - 771
[44] PtychoShelves, a versatile high-level framework for high-performance analysis of ptychographic data
Wakonig, Klaus
Stadler, Hans-Christian
Odstrcil, Michal
Tsai, Esther H. R.
Diaz, Ana
Holler, Mirko
Usov, Ivan
Raabe, Joerg
Menzel, Andreas
Guizar-Sicairos, Manuel
JOURNAL OF APPLIED CRYSTALLOGRAPHY, 2020, 53 : 574 - 586
[45] Low supply voltage high-performance CMOS current mirror with low input and output voltage requirements
Ramírez-Angulo, J
Carvajal, RG
Torralba, A
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2004, 51 (03) : 124 - 129
[46] High-performance work system in service sector: review and framework development
Dimple
Kuriakose, Vijay
SERVICE INDUSTRIES JOURNAL, 2025, 45 (3-4): : 374 - 406
[47] A High-Performance Energy Management System Based on Evolving Graph
Liu, Guangyi
Yuan, Chen
Chen, Xi
Wu, Jingjin
Dai, Renchang
Wang, Zhiwei
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (02) : 350 - 354
[48] Evolution of a high-performance PC architecture data processing system
Turri, M
DASIA 99: DATA SYSTEMS IN AEROSPACE, 1999, 447 : 73 - 78
[49] High-performance blockchain system for fast certification of manufacturing data
Costa, Diogo
Teixeira, Miguel
Pinto, Armando N.
Santos, Jose
SN APPLIED SCIENCES, 2022, 4 (01):
[50] CouchFS: A High-Performance File System for Large Data Sets
Yao, Fangzhou
Campbell, Roy H.
2014 IEEE INTERNATIONAL CONGRESS ON BIG DATA (BIGDATA CONGRESS), 2014, : 784 - 785

← 1 2 3 4 5 →