Efficient multi-objective calibration of a computationally intensive hydrologic model with parallel computing software in Python']Python

被引:86
作者
Zhang, Xuesong [1 ]
Beeson, Peter [2 ]
Link, Robert [1 ]
Manowitz, David [1 ]
Izaurralde, Roberto C. [1 ]
Sadeghi, Ali [2 ]
Thomson, Allison M. [1 ]
Sahajpal, Ritvik [3 ]
Srinivasan, Raghavan [4 ]
Arnold, Jeffrey G. [5 ]
机构
[1] Univ Maryland, Pacific NW Natl Lab, Joint Global Change Res Inst, College Pk, MD 20740 USA
[2] ARS, USDA, Beltsville, MD 20705 USA
[3] Univ Maryland, Dept Geog Sci, College Pk, MD 20740 USA
[4] Texas A&M Univ, Spatial Sci Lab, Dept Ecosyst Sci & Management, College Stn, TX 77845 USA
[5] USDA ARS, Grassland Soil & Water Res Lab, Temple, TX 76502 USA
关键词
Parallel processing; Evolutionary multi-objective optimization; High performance computer; Soil and water assessment tool; Parameter calibration; EFFECTS ASSESSMENT PROJECT; WATER ASSESSMENT-TOOL; AUTOMATIC CALIBRATION; GLOBAL OPTIMIZATION; SWAT MODEL; ALGORITHM; SOIL; SIMULATION; STRATEGIES; TERRAIN;
D O I
10.1016/j.envsoft.2013.03.013
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With enhanced data availability, distributed watershed models for large areas with high spatial and temporal resolution are increasingly used to understand water budgets and examine effects of human activities and climate change/variability on water resources. Developing parallel computing software to improve calibration efficiency has received growing attention of the watershed modeling community as it is very time demanding to run iteratively complex models for calibration. In this research, we introduce a Python-based parallel computing package, PP-SWAT, for efficient calibration of the Soil and Water Assessment Tool (SWAT) model. This software employs Python, MPI for Python (mpi4py) and OpenMPI to parallelize A Multi-method Genetically Adaptive Multi-objective Optimization Algorithm (AMALGAM), allowing for simultaneously addressing multiple objectives in calibrating SWAT. Test results on a Linux computer cluster showed that PP-SWAT can achieve a speedup of 45-109 depending on model complexity. Increasing the processor count beyond a certain threshold does not necessarily improve efficiency, because intensified resource competition may result in an I/O bottleneck. The efficiency achieved by PP-SWAT also makes it practical to implement multiple parameter adjustment schemes operating at different scales in affordable time, which helps provide SWAT users with a wider range of options of parameter sets to choose from for model(s) selection. PP-SWAT was not designed to address errors associated with other sources (e.g. model structure) and cautious supervision of its power should be exercised in order to attain physically meaningful calibration results. (C) 2013 Elsevier Ltd. All rights reserved.
引用
收藏
页码:208 / 218
页数:11
相关论文
共 58 条
[1]  
Arnold J. G., 2011, 365 BLACKL RES CTR T
[2]   Large area hydrologic modeling and assessment - Part 1: Model development [J].
Arnold, JG ;
Srinivasan, R ;
Muttiah, RS ;
Williams, JR .
JOURNAL OF THE AMERICAN WATER RESOURCES ASSOCIATION, 1998, 34 (01) :73-89
[3]   Continental scale simulation of the hydrologic balance [J].
Arnold, JG ;
Srinivasan, R ;
Muttiah, RS ;
Allen, PM .
JOURNAL OF THE AMERICAN WATER RESOURCES ASSOCIATION, 1999, 35 (05) :1037-1051
[4]  
Beeson PC, 2011, T ASABE, V54, P2011, DOI 10.13031/2013.40652
[5]   Sediment Delivery Estimates in Water Quality Models Altered by Resolution and Source of Topographic Data [J].
Beeson, Peter C. ;
Sadeghi, Ali M. ;
Lang, Megan W. ;
Tomer, Mark D. ;
Daughtry, Craig S. T. .
JOURNAL OF ENVIRONMENTAL QUALITY, 2014, 43 (01) :26-36
[6]  
Beven K.J., 2000, RAINFALL RUNOFF MODE
[7]   Little river experimental watershed database [J].
Bosch, D. D. ;
Sheridan, J. M. ;
Lowrance, R. R. ;
Hubbard, R. K. ;
Strickland, T. C. ;
Feyereisen, G. W. ;
Sullivan, D. G. .
WATER RESOURCES RESEARCH, 2007, 43 (09)
[8]   High-performance computing tools for the integrated assessment and modelling of social-ecological systems [J].
Bryan, Brett A. .
ENVIRONMENTAL MODELLING & SOFTWARE, 2013, 39 :295-303
[9]   Automatic calibration of hydrologic models with multi-objective evolutionary algorithm and Pareto optimization [J].
Confesor, Remegio B., Jr. ;
Whittaker, Gerald W. .
JOURNAL OF THE AMERICAN WATER RESOURCES ASSOCIATION, 2007, 43 (04) :981-989
[10]   Parallel distributed computing using Python']Python [J].
Dalcin, Lisandro D. ;
Paz, Rodrigo R. ;
Kler, Pablo A. ;
Cosimo, Alejandro .
ADVANCES IN WATER RESOURCES, 2011, 34 (09) :1124-1139