Estimating extremely large amounts of missing precipitation data

被引:34
作者
Aguilera, Hector [1 ]
Guardiola-Albert, Carolina [1 ]
Serrano-Hidalgo, Carmen [1 ,2 ]
机构
[1] Geol Survey Spain, Res Geol Resources, Rios Roses 23, Madrid 28003, Spain
[2] Tech Univ Madrid, Sch Min Engn Madrid, Rios Rosas 21, Madrid 28003, Spain
关键词
evaluation; large missing precipitation; multiple imputation; random forest; spatio-temporal kriging; MULTIPLE IMPUTATION; RAINFALL DATA; SPATIAL INTERPOLATION; RECORDS; SERIES; VALUES;
D O I
10.2166/hydro.2020.127
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Accurate estimation of missing daily precipitation data remains a difficult task. A wide variety of methods exists for infilling missing values, but the percentage of gaps is one of the main factors limiting their applicability. The present study compares three techniques for filling in large amounts of missing daily precipitation data: spatio-temporal kriging (STK), multiple imputation by chained equations through predictive mean matching (PMM), and the random forest (RF) machine learning algorithm. To our knowledge, this is the first time that extreme missingness (>90%) has been considered. Different percentages of missing data and missing patterns are tested in a large dataset drawn from 112 rain gauges in the period 1975-2017. The results show that both STK and RF can handle extreme missingness, while PMM requires larger observed sample sizes. STK is the most robust method, suitable for chronological missing patterns. RF is efficient under random missing patterns. Model evaluation is usually based on performance and error measures. However, this study outlines the risk of just relying on these measures without checking for consistency. The RF algorithm overestimated daily precipitation outside the validation period in some cases due to the overdetection of rainy days under time-dependent missing patterns.
引用
收藏
页码:578 / 592
页数:15
相关论文
共 35 条
[1]  
[Anonymous], 2009, Multiple Imputation for Nonresponse in Surveys
[2]  
[Anonymous], 10281 KNMI ROYAL NET
[3]   Infilling missing precipitation records - A comparison of a new copula-based method with other techniques [J].
Bardossy, Andras ;
Pegram, Geoffrey .
JOURNAL OF HYDROLOGY, 2014, 519 :1162-1170
[4]   Multivariate missing data in hydrology - Review and applications [J].
Ben Aissia, Mohamed-Aymen ;
Chebana, Fateh ;
Ouarda, Taha B. M. J. .
ADVANCES IN WATER RESOURCES, 2017, 110 :299-309
[5]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[6]  
Burhanuddin SNZA, 2017, INT J GEOMATE, V13, P131, DOI 10.21660/2017.36.2760
[7]   Comparison of the multiple imputation approaches for imputing rainfall data series and their applications to watershed models [J].
Chen, Lei ;
Xu, Jiajia ;
Wang, Guobo ;
Shen, Zhenyao .
JOURNAL OF HYDROLOGY, 2019, 572 :449-460
[8]   Separable approximations of space-time covariance matrices [J].
Genton, Marc G. .
ENVIRONMETRICS, 2007, 18 (07) :681-695
[9]  
Gräler B, 2016, R J, V8, P204
[10]   Multiple imputation: Review of theory, implementation and software [J].
Harel, Ofer ;
Zhou, Xiao-Hua .
STATISTICS IN MEDICINE, 2007, 26 (16) :3057-3077