Watershed modeling using large-scale distributed computing in Condor and the Soil and Water Assessment Tool model

被引:2
|
作者
Gitau, Margaret W. [3 ]
Chiang, Li-Chi
Sayeed, Mohamed [4 ]
Chaubey, Indrajeet [1 ,2 ]
机构
[1] Purdue Univ, Dept Agr & Biol Engn, Dept Earth & Atmospher Sci, W Lafayette, IN 47907 USA
[2] Purdue Univ, Div Environm & Ecol Engn, W Lafayette, IN 47907 USA
[3] Florida A&M Univ, Ctr Water & Air Qual, Tallahassee, FL 32307 USA
[4] Rosen Ctr Adv Comp, Comp Res Inst, W Lafayette, IN 47907 USA
来源
SIMULATION-TRANSACTIONS OF THE SOCIETY FOR MODELING AND SIMULATION INTERNATIONAL | 2012年 / 88卷 / 03期
关键词
best management practices; Condor; Conservation Effectiveness Assessment Program; Lincoln Lake; Soil and Water Assessment Tool Model; TeraGrid; POULTRY LITTER APPLICATION; SWAT MODEL; MANAGEMENT-PRACTICES; SENSITIVITY-ANALYSIS; QUALITY; CALIBRATION; IMPACTS; FLOW; UNCERTAINTY; MULTISITE;
D O I
10.1177/0037549711402524
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Models are increasingly being used to quantify the effects of best management practices (BMPs) on water quality. While these models offer the ability to study multiple BMP scenarios, and to analyze impacts of various management decisions on watershed response, associated analyses can be very computationally intensive due to a large number of runs needed to fully capture the various uncertainties in the model outputs. There is, thus, the need to develop suitable and efficient techniques to handle such comprehensive model evaluations. We demonstrate a novel approach to accomplish a large number of model runs with Condor, a distributed high-throughput computing framework for model runs with the Soil and Water Assessment Tool (SWAT) model. This application required more than 43,000 runs of the SWAT model to evaluate the impacts of 172 different watershed management decisions combined with weather uncertainty on water quality. The SWAT model was run in the Condor environment implemented on the TeraGrid. This framework significantly reduced the model run time from 2.5 years to 18 days and enabled us to perform comprehensive BMP analyses that may not have been possible with traditional model runs on a few desktop computers. The Condor system can be used effectively to make Monte Carlo analyses of complex watershed models requiring a large number of computational cycles.
引用
收藏
页码:365 / 380
页数:16
相关论文
共 50 条
  • [31] Large-Scale Distributed Graph Computing Systems: An Experimental Evaluation
    Lu, Yi
    Cheng, James
    Yan, Da
    Wu, Huanhuan
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 8 (03): : 281 - 292
  • [32] Distributed computing practice for large-scale science and engineering applications
    Jha, Shantenu
    Cole, Murray
    Katz, Daniel S.
    Parashar, Manish
    Rana, Omer
    Weissman, Jon
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2013, 25 (11): : 1559 - 1585
  • [33] A Large-Scale Distributed Sorting Algorithm Based on Cloud Computing
    Pang, Na
    Zhu, Dali
    Fan, Zheming
    Rong, Wenjing
    Feng, Weimiao
    APPLICATIONS AND TECHNIQUES IN INFORMATION SECURITY, ATIS 2015, 2015, 557 : 226 - 237
  • [34] Application of Large-Scale, Multi-Resolution Watershed Modeling Framework Using the Hydrologic and Water Quality System (HAWQS)
    Yen, Haw
    Daggupati, Prasad
    White, Michael J.
    Srinivasan, Raghavan
    Gossel, Arndt
    Wells, David
    Arnold, Jeffrey G.
    WATER, 2016, 8 (04):
  • [35] A Workflow for Parallel and Distributed Computing of Large-Scale Genomic Data
    Choi, Hyun-Hwa
    Kim, Byoung-Seob
    Ahn, Shin-Young
    Bae, Seung-Jo
    2013 8TH INTERNATIONAL CONFERENCE FOR INTERNET TECHNOLOGY AND SECURED TRANSACTIONS (ICITST), 2013, : 215 - 218
  • [36] Interactive visualization in large-scale, distributed computing infrastructures with GVK
    Heinzlreiter, P
    Kranzlmüller, D
    Kurka, G
    Volkert, J
    6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL IV, PROCEEDINGS: MOBILE/WIRELESS COMPUTING AND COMMUNICATION SYSTEMS I, 2002, : 348 - 352
  • [37] Advanced computing in intelligent large-scale distributed systems - Preface
    Koodziej, Joanna
    Nishino, Hiroaki
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 2012, 27 (01): : 5 - 6
  • [38] QUANTITATIVE MODELING OF SOIL EROSION BY WATER IN LARGE-SCALE RIVER BASIN USING REMOTELY SENSED DATA
    Zhu, Qiang
    Chen, Xiuwan
    Fan, Qixiang
    Jin, Heping
    2010 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2010, : 3845 - 3848
  • [39] Palantir: Reseizing Network Proximity in Large-scale Distributed Computing Frameworks Using SDN
    Yu, Ze
    Li, Min
    Yang, Xin
    Li, Xiaolin
    2014 IEEE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD), 2014, : 441 - 448
  • [40] 100 Million Dimensions Large-Scale Global Optimization Using Distributed GPU Computing
    Cano, Alberto
    Garcia-Martinez, Carlos
    2016 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2016, : 3566 - 3573