Parallelization of a hydrological model using the message passing interface

被引:55
作者
Wu, Yiping [1 ,2 ]
Li, Tiejian [3 ]
Sun, Liqun [2 ]
Chen, Ji [2 ]
机构
[1] USGS, ASRC Res & Technol Solut, Earth Resources Observat & Sci EROS Ctr, Sioux Falls, SD 57198 USA
[2] Univ Hong Kong, Dept Civil Engn, Pokfulam, Hong Kong, Peoples R China
[3] Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
关键词
Hydrological model; Message passing; Parallelization; SWAT; WATER ASSESSMENT-TOOL; SWAT MODEL; LARGE-SCALE; CALIBRATION; SOIL; POLLUTION; SIMULATION; RESERVOIR;
D O I
10.1016/j.envsoft.2013.02.002
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the increasing knowledge about the natural processes, hydrological models such as the Soil and Water Assessment Tool (SWAT) are becoming larger and more complex with increasing computation time. Additionally, other procedures such as model calibration, which may require thousands of model iterations, can increase running time and thus further reduce rapid modeling and analysis. Using the widely-applied SWAT as an example, this study demonstrates how to parallelize a serial hydrological model in a Windows (R) environment using a parallel programing technology-Message Passing Interface (MPI). With a case study, we derived the optimal values for the two parameters (the number of processes and the corresponding percentage of work to be distributed to the master process) of the parallel SWAT (P-SWAT) on an ordinary personal computer and a work station. Our study indicates that model execution time can be reduced by 42%-70% (or a speedup of 1.74-3.36) using multiple processes (two to five) with a proper task-distribution scheme (between the master and slave processes). Although the computation time cost becomes lower with an increasing number of processes (from two to five), this enhancement becomes less due to the accompanied increase in demand for message passing procedures between the master and all slave processes. Our case study demonstrates that the P-SWAT with a five-process run may reach the maximum speedup, and the performance can be quite stable (fairly independent of a project size). Overall, the P-SWAT can help reduce the computation time substantially for an individual model run, manual and automatic calibration procedures, and optimization of best management practices. In particular, the parallelization method we used and the scheme for deriving the optimal parameters in this study can be valuable and easily applied to other hydrological or environmental models. Published by Elsevier Ltd.
引用
收藏
页码:124 / 132
页数:9
相关论文
共 50 条
[41]   Hydrological modeling of Oued El Abiod watershed using the SWAT model [J].
Adel Bougamouza ;
Boualem Remini .
Arabian Journal of Geosciences, 2022, 15 (13)
[42]   Hydrological Response Assessment of Land Cover Change in a Peruvian Amazonian Basin Impacted by Deforestation Using the SWAT Model [J].
Paiva, Karla ;
Rau, Pedro ;
Montesinos, Cristian ;
Lavado-Casimiro, Waldo ;
Bourrel, Luc ;
Frappart, Frederic .
REMOTE SENSING, 2023, 15 (24)
[43]   MPICH-G2: A Grid-enabled implementation of the Message Passing Interface [J].
Karonis, NT ;
Toonen, B ;
Foster, I .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2003, 63 (05) :551-563
[44]   THE DESIGN OF A STANDARD MESSAGE-PASSING INTERFACE FOR DISTRIBUTED-MEMORY CONCURRENT COMPUTERS [J].
WALKER, DW .
PARALLEL COMPUTING, 1994, 20 (04) :657-673
[45]   Face recognition using message passing based clustering method [J].
Du, Chunhua ;
Yang, Jie ;
Wu, Qiang ;
Zhang, Tianhao .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2009, 20 (08) :608-613
[46]   Track fusion for airborne radar network using message passing [J].
Bai X.-L. ;
Pan Q. ;
Ma E.-C. ;
Hao Y.-H. ;
Yun T. .
Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2024, 41 (07) :1235-1245
[47]   Calibrating a Hydrological Model in an Ungauged Mountain Basin with the Budyko Framework [J].
Yu, Zexing ;
Chen, Xiaohong ;
Wu, Jiefeng .
WATER, 2022, 14 (19)
[48]   Spatially distributed model calibration of a highly managed hydrological system using remote sensing-derived ET data [J].
Becker, Rike ;
Koppa, Akash ;
Schulz, Stephan ;
Usman, Muhammad ;
Beek, Tim Aus Der ;
Schueth, Christoph .
JOURNAL OF HYDROLOGY, 2019, 577
[49]   Vector Approximate Message Passing [J].
Rangan, Sundeep ;
Schniter, Philip ;
Fletcher, Alyson K. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2019, 65 (10) :6664-6684
[50]   Hydrological modeling for the Bharathapuzha River basin of South India using SWAT model [J].
Nair, Gulja S. ;
Karunanidhi, D. ;
Subramani, T. .
DESALINATION AND WATER TREATMENT, 2025, 321