The SPAtial EFficiency metric (SPAEF): multiple-component evaluation of spatial patterns for optimization of hydrological models

被引:110
作者
Koch, Julian [1 ]
Demirel, Mehmet Cuneyd [1 ,2 ]
Stisen, Simon [1 ]
机构
[1] Geol Survey Denmark & Greenland, Dept Hydrol, DK-1350 Copenhagen, Denmark
[2] Istanbul Tech Univ, Dept Civil Engn, TR-34469 Istanbul, Turkey
关键词
LAND-SURFACE TEMPERATURE; SATELLITE DATA; PRECIPITATION FORECASTS; SENSITIVITY-ANALYSIS; PERFORMANCE; WATER; VERIFICATION; FLUXES; SOIL; PARAMETERIZATION;
D O I
10.5194/gmd-11-1873-2018
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
The process of model evaluation is not only an integral part of model development and calibration but also of paramount importance when communicating modelling results to the scientific community and stakeholders. The modelling community has a large and well-tested toolbox of metrics to evaluate temporal model performance. In contrast, spatial performance evaluation does not correspond to the grand availability of spatial observations readily available and to the sophisticate model codes simulating the spatial variability of complex hydrological processes. This study makes a contribution towards advancing spatial-pattern-oriented model calibration by rigorously testing a multiple-component performance metric. The promoted SPAtial EFficiency (SPAEF) metric reflects three equally weighted components: correlation, coefficient of variation and histogram overlap. This multiple-component approach is found to be advantageous in order to achieve the complex task of comparing spatial patterns. SPAEF, its three components individually and two alternative spatial performance metrics, i.e. connectivity analysis and fractions skill score, are applied in a spatial-pattern-oriented model calibration of a catchment model in Denmark. Results suggest the importance of multiple-component metrics because stand-alone metrics tend to fail to provide holistic pattern information. The three SPAEF components are found to be independent, which allows them to complement each other in a meaningful way. In order to optimally exploit spatial observations made available by remote sensing platforms, this study suggests applying bias insensitive metrics which further allow for a comparison of variables which are related but may differ in unit. This study applies SPAEF in the hydrological context using the mesoscale Hydrologic Model (mHM; version 5.8), but we see great potential across disciplines related to spatially distributed earth system modelling.
引用
收藏
页码:1873 / 1886
页数:14
相关论文
共 70 条
[1]   Technical assessment and evaluation of environmental models and software: Letter to the Editor [J].
Alexandrov, G. A. ;
Ames, D. ;
Bellocchi, G. ;
Bruen, M. ;
Crout, N. ;
Erechtchoukova, M. ;
Hildebrandt, A. ;
Hoffman, F. ;
Jackisch, C. ;
Khaiter, P. ;
Mannina, G. ;
Matsunaga, T. ;
Purucker, S. T. ;
Rivington, M. ;
Samaniego, L. .
ENVIRONMENTAL MODELLING & SOFTWARE, 2011, 26 (03) :328-336
[2]   Characterising performance of environmental models [J].
Bennett, Neil D. ;
Croke, Barry F. W. ;
Guariso, Giorgio ;
Guillaume, Joseph H. A. ;
Hamilton, Serena H. ;
Jakeman, Anthony J. ;
Marsili-Libelli, Stefano ;
Newham, Lachlan T. H. ;
Norton, John P. ;
Perrin, Charles ;
Pierce, Suzanne A. ;
Robson, Barbara ;
Seppelt, Ralf ;
Voinov, Alexey A. ;
Fath, Brian D. ;
Andreassian, Vazken .
ENVIRONMENTAL MODELLING & SOFTWARE, 2013, 40 :1-20
[3]  
Brown B G, 2009, 25 C INT INT INF PRO
[4]   Pursuing the method of multiple working hypotheses for hydrological modeling [J].
Clark, Martyn P. ;
Kavetski, Dmitri ;
Fenicia, Fabrizio .
WATER RESOURCES RESEARCH, 2011, 47
[5]   Evaluating forecasts of extreme events for hydrological applications: an approach for screening unfamiliar performance measures [J].
Cloke, Hannah L. ;
Pappenberger, Florian .
METEOROLOGICAL APPLICATIONS, 2008, 15 (01) :181-197
[6]   Calibration and Validation of a Distributed Energy-Water Balance Model Using Satellite Data of Land Surface Temperature and Ground Discharge Measurements [J].
Corbari, Chiara ;
Mancini, Marco .
JOURNAL OF HYDROMETEOROLOGY, 2014, 15 (01) :376-392
[7]   Computationally inexpensive identification of noninformative model parameters by sequential screening [J].
Cuntz, Matthias ;
Mai, Juliane ;
Zink, Matthias ;
Thober, Stephan ;
Kumar, Rohini ;
Schaefer, David ;
Schroen, Martin ;
Craven, John ;
Rakovec, Oldrich ;
Spieler, Diana ;
Prykhodko, Vladyslav ;
Dalmasso, Giovanni ;
Musuuza, Jude ;
Langenberg, Ben ;
Attinger, Sabine ;
Samaniego, Luis .
WATER RESOURCES RESEARCH, 2015, 51 (08) :6417-6441
[8]   HydroTest: A web-based toolbox of evaluation metrics for the standardised assessment of hydrological forecasts [J].
Dawson, C. W. ;
Abrahart, R. J. ;
See, L. M. .
ENVIRONMENTAL MODELLING & SOFTWARE, 2007, 22 (07) :1034-1052
[9]   Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model [J].
Demirel, Mehmet C. ;
Mai, Juliane ;
Mendiguren, Gorka ;
Koch, Julian ;
Samaniego, Luis ;
Stisen, Simon .
HYDROLOGY AND EARTH SYSTEM SCIENCES, 2018, 22 (02) :1299-1315
[10]  
Doherty J., 2010, PEST: Model Independent Parameter Estimation User Manual, V5th