Moving SWAT model calibration and uncertainty analysis to an enterprise Hadoop-based cloud

被引:33
作者
Zhang, Dejian [1 ]
Chen, Xingwei [1 ,2 ]
Yao, Huaxia [3 ]
James, April [4 ]
机构
[1] Fujian Normal Univ, Coll Geog Sci, Fuzhou 350007, Fujian, Peoples R China
[2] Cultivat Base State Key Lab Humid Subtrop Mt Ecol, Fuzhou 350007, Fujian, Peoples R China
[3] Ontario Minist Environm & Climate Change, Dorset Environm Sci Ctr, 1026 Bellwood Rd, Dorset, ON P0A 1E0, Canada
[4] Nipissing Univ, Dept Geog, 100 Coll Dr,Box 5002, North Bay, ON P1B 8L7, Canada
基金
中国国家自然科学基金;
关键词
Auto calibration; CUT-SWAT; Cloud computing; Enterprise cloud; SWAT; Uncertainty analysis; RAINFALL-RUNOFF MODELS; WATER-QUALITY; PARAMETER UNCERTAINTY; GLOBAL OPTIMIZATION; RIVER-BASIN; ALGORITHM; SOIL; IDENTIFY; SYSTEM; FUTURE;
D O I
10.1016/j.envsoft.2016.06.024
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With enhanced availability of high spatial resolution data, hydrologic models such as the Soil and Water Assessment Tool (SWAT) are increasingly used to investigate effects of management activities and climate change on water availability and quality. The advantages come at a price of greater computational demand and run time. This becomes challenging to model calibration and uncertainty analysis as these routines involve a large number of model runs. For efficient modelling, a cloud-based Calibration and Uncertainty analysis Tool for SWAT (CUT-SWAT) was implemented using Hadoop, an open source cloud platform, and the Generalized Likelihood Uncertainty Estimation method. Test results on an enterprise cloud showed that CUT-SWAT can significantly speedup the calibration and uncertainty analysis processes with a speedup of 21.7-26.6 depending on model complexity and provides a flexible and fault tolerant model execution environment (it can gracefully and automatically handle partial failure), thus would be an ideal method to solve computational demand problems in hydrological modelling. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:140 / 148
页数:9
相关论文
共 42 条
  • [1] Abbaspour K.C., 2007, SWAT-CUP 2012: SWAT calibration and uncertainty programs- A user manual
  • [2] Modelling hydrology and water quality in the pre-alpine/alpine Thur watershed using SWAT
    Abbaspour, Karim C.
    Yang, Jing
    Maximov, Ivan
    Siber, Rosi
    Bogner, Konrad
    Mieleitner, Johanna
    Zobrist, Juerg
    Srinivasan, Raghavan
    [J]. JOURNAL OF HYDROLOGY, 2007, 333 (2-4) : 413 - 430
  • [3] [Anonymous], 2003, WATER RESOUR RES
  • [4] [Anonymous], 2009, Hadoop: The Definitive Guide
  • [5] Large area hydrologic modeling and assessment - Part 1: Model development
    Arnold, JG
    Srinivasan, R
    Muttiah, RS
    Williams, JR
    [J]. JOURNAL OF THE AMERICAN WATER RESOURCES ASSOCIATION, 1998, 34 (01): : 73 - 89
  • [6] SWAT2000: current capabilities and research opportunities in applied watershed modelling
    Arnold, JG
    Fohrer, N
    [J]. HYDROLOGICAL PROCESSES, 2005, 19 (03) : 563 - 572
  • [7] THE FUTURE OF DISTRIBUTED MODELS - MODEL CALIBRATION AND UNCERTAINTY PREDICTION
    BEVEN, K
    BINLEY, A
    [J]. HYDROLOGICAL PROCESSES, 1992, 6 (03) : 279 - 298
  • [8] Generalized likelihood uncertainty estimation (GLUE) using adaptive Markov chain Monte Carlo sampling
    Blasone, Roberta-Serena
    Vrugt, Jasper A.
    Madsen, Henrik
    Rosbjerg, Dan
    Robinson, Bruce A.
    Zyvoloski, George A.
    [J]. ADVANCES IN WATER RESOURCES, 2008, 31 (04) : 630 - 648
  • [9] A Bayesian approach to parameter estimation and pooling in nonlinear flood event models
    Campbell, EP
    Fox, DR
    Bates, BC
    [J]. WATER RESOURCES RESEARCH, 1999, 35 (01) : 211 - 220
  • [10] Center for Agricultural and Rural Development (CARD), 2015, SWAT J ART LIT DAT