Parallelization of a hydrological model using the message passing interface

被引:55
作者
Wu, Yiping [1 ,2 ]
Li, Tiejian [3 ]
Sun, Liqun [2 ]
Chen, Ji [2 ]
机构
[1] USGS, ASRC Res & Technol Solut, Earth Resources Observat & Sci EROS Ctr, Sioux Falls, SD 57198 USA
[2] Univ Hong Kong, Dept Civil Engn, Pokfulam, Hong Kong, Peoples R China
[3] Tsinghua Univ, State Key Lab Hydrosci & Engn, Beijing 100084, Peoples R China
关键词
Hydrological model; Message passing; Parallelization; SWAT; WATER ASSESSMENT-TOOL; SWAT MODEL; LARGE-SCALE; CALIBRATION; SOIL; POLLUTION; SIMULATION; RESERVOIR;
D O I
10.1016/j.envsoft.2013.02.002
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the increasing knowledge about the natural processes, hydrological models such as the Soil and Water Assessment Tool (SWAT) are becoming larger and more complex with increasing computation time. Additionally, other procedures such as model calibration, which may require thousands of model iterations, can increase running time and thus further reduce rapid modeling and analysis. Using the widely-applied SWAT as an example, this study demonstrates how to parallelize a serial hydrological model in a Windows (R) environment using a parallel programing technology-Message Passing Interface (MPI). With a case study, we derived the optimal values for the two parameters (the number of processes and the corresponding percentage of work to be distributed to the master process) of the parallel SWAT (P-SWAT) on an ordinary personal computer and a work station. Our study indicates that model execution time can be reduced by 42%-70% (or a speedup of 1.74-3.36) using multiple processes (two to five) with a proper task-distribution scheme (between the master and slave processes). Although the computation time cost becomes lower with an increasing number of processes (from two to five), this enhancement becomes less due to the accompanied increase in demand for message passing procedures between the master and all slave processes. Our case study demonstrates that the P-SWAT with a five-process run may reach the maximum speedup, and the performance can be quite stable (fairly independent of a project size). Overall, the P-SWAT can help reduce the computation time substantially for an individual model run, manual and automatic calibration procedures, and optimization of best management practices. In particular, the parallelization method we used and the scheme for deriving the optimal parameters in this study can be valuable and easily applied to other hydrological or environmental models. Published by Elsevier Ltd.
引用
收藏
页码:124 / 132
页数:9
相关论文
共 50 条
  • [21] Parallelization of AMALGAM algorithm for a multi-objective optimization of a hydrological model
    Ali A. Besalatpour
    Mohsen Pourreza-Bilondi
    Amirhosein Aghakhani Afshar
    Applied Water Science, 2023, 13
  • [22] A Probability-Based Trust Prediction Model Using Trust-Message Passing
    Oh, Hyun-Kyo
    Kim, Jin-Woo
    Kim, Sang-Wook
    Lee, Kichun
    PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'13 COMPANION), 2013, : 161 - 162
  • [23] Assessment of hydrological behavioural changes of Noyyal watershed in Coimbatore district, India by using SWAT model
    Arumugam, Thangavelu
    Kinattinkara, Sapna
    Velusamy, Sampathkumar
    Shanmugamoorthy, Manoj
    Veerasamy, Senthilkumar
    URBAN CLIMATE, 2025, 59
  • [24] Parallelization of the distinct lattice spring model
    Zhao, Gao-Feng
    Fang, Jiannong
    Sun, Liang
    Zhao, Jian
    INTERNATIONAL JOURNAL FOR NUMERICAL AND ANALYTICAL METHODS IN GEOMECHANICS, 2013, 37 (01) : 51 - 74
  • [25] A Partitioning Parallelization with Hybrid Migration of MOEA/D for Bi-Objective Optimization on Message-Passing Clusters
    Wu, Yu
    Xie, Yuehong
    Ying, Weiqin
    Xu, Xing
    Liu, Zixing
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2016, E99A (04) : 843 - 848
  • [26] Using Bayesian optimization to automate the calibration of complex hydrological models: Framework and application
    Ma, Jinfeng
    Zhang, Jing
    Li, Ruonan
    Zheng, Hua
    Li, Weifeng
    ENVIRONMENTAL MODELLING & SOFTWARE, 2022, 147
  • [27] Universal partially evolved parallelization of MOEA/D for multi-objective optimization on message-passing clusters
    Weiqin Ying
    Yuehong Xie
    Yu Wu
    Bingshen Wu
    Shiyun Chen
    Weipeng He
    Soft Computing, 2017, 21 : 5399 - 5412
  • [28] Universal partially evolved parallelization of MOEA/D for multi-objective optimization on message-passing clusters
    Ying, Weiqin
    Xie, Yuehong
    Wu, Yu
    Wu, Bingshen
    Chen, Shiyun
    He, Weipeng
    SOFT COMPUTING, 2017, 21 (18) : 5399 - 5412
  • [29] Hydrological modelling of upper Ebonyi watershed using the SWAT model
    Ndulue E.L.
    Ezenne G.I.
    Mbajiorgu C.C.
    Ogwo V.
    Ogbu K.N.
    International Journal of Hydrology Science and Technology, 2018, 8 (02) : 120 - 133
  • [30] MPI/RT: Design and implementation of a real-time message passing interface
    Cui, ZQ
    Kanevsky, A
    Li, J
    Skjellum, A
    INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, VOLS I-III, PROCEEDINGS, 1997, : 334 - 343