SERGHEI (SERGHEI-SWE) v1.0: a performance-portable high-performance parallel-computing shallow-water solver for hydrology and environmental hydraulics

被引:34
作者
Caviedes-Voullieme, Daniel [1 ,2 ]
Morales-Hernandez, Mario [3 ,4 ]
Norman, Matthew R. [4 ]
Oezgen-Xian, Ilhan [5 ,6 ]
机构
[1] Forschungszentrum Julich, Julich Supercomp Ctr, Simulat & Data Lab Terr Syst, Julich, Germany
[2] Forschungszentrum Julich, Inst Bio & Geosci Agrosphere IBG 3, Julich, Germany
[3] Univ Zaragoza, Fluid Mech, I3A, Zaragoza, Spain
[4] Oak Ridge Natl Lab, Oak Ridge, TN USA
[5] Tech Univ Carolo Wilhelmina Braunschweig, Inst Geoecol, Braunschweig, Germany
[6] Lawrence Berkeley Natl Lab, Earth & Environm Sci Area, Berkeley, CA USA
关键词
FINITE-VOLUME SCHEME; OVERLAND-FLOW; RIEMANN SOLVERS; RAINFALL-RUNOFF; TERM DISCRETIZATION; GPU-IMPLEMENTATION; PRECIPITATION DATA; NUMERICAL-MODEL; MUSCL SCHEME; EQUATIONS;
D O I
10.5194/gmd-16-977-2023
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
The Simulation EnviRonment for Geomorphology, Hydrodynamics, and Ecohydrology in Integrated form (SERGHEI) is a multi-dimensional, multi-domain,and multi-physics model framework for environmental and landscape simulation, designed with an outlook towards Earth system modelling. At the coreof SERGHEI's innovation is its performance-portable high-performance parallel-computing (HPC) implementation, built from scratch on the Kokkos portability layer, allowing SERGHEI to be deployed, in a performance-portable fashion, in graphics processing unit (GPU)-based heterogeneous systems. In this work, we explore combinations of MPI and Kokkos usingOpenMP and CUDA backends. In this contribution, we introduce the SERGHEI model framework and present with detail its first operational modulefor solving shallow-water equations (SERGHEI-SWE) and its HPC implementation. This module is designed to be applicable to hydrological andenvironmental problems including flooding and runoff generation, with an outlook towards Earth system modelling. Its applicability is demonstratedby testing several well-known benchmarks and large-scale problems, for which SERGHEI-SWE achieves excellent results for the different types ofshallow-water problems. Finally, SERGHEI-SWE scalability and performance portability is demonstrated and evaluated on several TOP500 HPCsystems, with very good scaling in the range of over 20 000 CPUs and up to 256 state-of-the art GPUs.
引用
收藏
页码:977 / 1008
页数:32
相关论文
共 178 条
[1]   Modelling flash flood propagation in urban areas using a two-dimensional numerical model [J].
Abderrezzak, Kamal El Kadi ;
Paquier, Andre ;
Mignot, Emmanuel .
NATURAL HAZARDS, 2009, 50 (03) :433-460
[2]   Exascale applications: skin in the game [J].
Alexander, Francis ;
Almgren, Ann ;
Bell, John ;
Bhattacharjee, Amitava ;
Chen, Jacqueline ;
Colella, Phil ;
Daniel, David ;
DeSlippe, Jack ;
Diachin, Lori ;
Draeger, Erik ;
Dubey, Anshu ;
Dunning, Thom ;
Evans, Thomas ;
Foster, Ian ;
Francois, Marianne ;
Germann, Tim ;
Gordon, Mark ;
Habib, Salman ;
Halappanavar, Mahantesh ;
Hamilton, Steven ;
Hart, William ;
Huang, Zhenyu ;
Hungerford, Aimee ;
Kasen, Daniel ;
Kent, Paul R. C. ;
Kolev, Tzanio ;
Kothe, Douglas B. ;
Kronfeld, Andreas ;
Luo, Ye ;
Mackenzie, Paul ;
McCallen, David ;
Messer, Bronson ;
Mniszewski, Sue ;
Oehmen, Chris ;
Perazzo, Amedeo ;
Perez, Danny ;
Richards, David ;
Rider, William J. ;
Rieben, Rob ;
Roche, Kenneth ;
Siegel, Andrew ;
Sprague, Michael ;
Steefel, Carl ;
Stevens, Rick ;
Syamlal, Madhava ;
Taylor, Mark ;
Turner, John ;
Vay, Jean-Luc ;
Voter, Artur F. ;
Windus, Theresa L. .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2020, 378 (2166)
[3]   Analysis of an open source quadtree grid shallow water flow solver for flood simulation [J].
An, Hyunuk ;
Yu, Soonyoung ;
Lee, Giha ;
Kim, Yeonsu .
QUATERNARY INTERNATIONAL, 2015, 384 :118-128
[4]  
[Anonymous], 2004, 3 INT WORKSH LONG WA
[5]   r-adaptation for Shallow Water flows: conservation, well balancedness, efficiency [J].
Arpaia, Luca ;
Ricchiuto, Mario .
COMPUTERS & FLUIDS, 2018, 160 :175-203
[6]   Evaluation of performance portability frameworks for the implementation of a particle-in-cell code [J].
Artigues, Victor ;
Kormann, Katharina ;
Rampp, Markus ;
Reuter, Klaus .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2020, 32 (11)
[7]   A weighted surface-depth gradient method for the numerical integration of the 2D shallow water equations with topography [J].
Aureli, F. ;
Maranzoni, A. ;
Mignosa, P. ;
Ziveri, C. .
ADVANCES IN WATER RESOURCES, 2008, 31 (07) :962-974
[8]   Review of Historical Dam-Break Events and Laboratory Tests on Real Topography for the Validation of Numerical Models [J].
Aureli, Francesca ;
Maranzoni, Andrea ;
Petaccia, Gabriella .
WATER, 2021, 13 (14)
[9]   A GPU-Accelerated Shallow-Water Scheme for Surface Runoff Simulations [J].
Aureli, Francesca ;
Prost, Federico ;
Vacondio, Renato ;
Dazzi, Susanna ;
Ferrari, Alessia .
WATER, 2020, 12 (03)
[10]   Second-order discontinuous Galerkin flood model: Comparison with industry-standard finite volume models [J].
Ayog, Janice Lynn ;
Kesserwani, Georges ;
Shaw, James ;
Sharifian, Mohammad Kazem ;
Bau, Domenico .
JOURNAL OF HYDROLOGY, 2021, 594