Decomposition of the mean absolute error (MAE) into systematic and unsystematic components

被引:73
作者
Robeson, Scott M. [1 ]
Willmott, Cort J. [2 ]
机构
[1] Indiana Univ, Dept Geog, Bloomington, IN USA
[2] Univ Delaware, Dept Geog, Newark, DC USA
关键词
D O I
10.1371/journal.pone.0279774
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
When evaluating the performance of quantitative models, dimensioned errors often are characterized by sums-of-squares measures such as the mean squared error (MSE) or its square root, the root mean squared error (RMSE). In terms of quantifying average error, however, absolute-value-based measures such as the mean absolute error (MAE) are more interpretable than MSE or RMSE. Part of that historical preference for sums-of-squares measures is that they are mathematically amenable to decomposition and one can then form ratios, such as those based on separating MSE into its systematic and unsystematic components. Here, we develop and illustrate a decomposition of MAE into three useful submeasures: (1) bias error, (2) proportionality error, and (3) unsystematic error. This three-part decomposition of MAE is preferable to comparable decompositions of MSE because it provides more straightforward information on the nature of the model-error distribution. We illustrate the properties of our new three-part decomposition using a long-term reconstruction of streamflow for the Upper Colorado River.
引用
收藏
页数:8
相关论文
共 16 条
[1]   A multimodel ensemble approach to assessment of climate change impacts on the hydrology and water resources of the Colorado River Basin [J].
Christensen, N. S. ;
Lettenmaier, D. P. .
HYDROLOGY AND EARTH SYSTEM SCIENCES, 2007, 11 (04) :1417-1434
[2]   Bias-variance decomposition of absolute errors for diagnosing regression models of continuous data [J].
Gao, Jing .
PATTERNS, 2021, 2 (08)
[3]   Introductory overview: Error metrics for hydrologic modelling - A review of common practices and an open source library to facilitate use and adoption [J].
Jackson, Elise K. ;
Roberts, Wade ;
Nelsen, Benjamin ;
Williams, Gustavious P. ;
Nelson, E. James ;
Ames, Daniel P. .
ENVIRONMENTAL MODELLING & SOFTWARE, 2019, 119 :32-48
[4]   Evaluating the use of "goodness-of-fit" measures in hydrologic and hydroclimatic model validation [J].
Legates, DR ;
McCabe, GJ .
WATER RESOURCES RESEARCH, 1999, 35 (01) :233-241
[5]   Medieval drought in the upper Colorado River Basin [J].
Meko, David M. ;
Woodhouse, Connie A. ;
Baisan, Christopher A. ;
Knight, Troy ;
Lukas, Jeffrey J. ;
Hughes, Malcolm K. ;
Salzer, Matthew W. .
GEOPHYSICAL RESEARCH LETTERS, 2007, 34 (10)
[6]  
Mielke PW, 2007, SPRINGER SER STAT, P1, DOI 10.1007/978-0-387-69813-7
[7]  
Nash J. E., 1970, J. Hydrol, V10, P282, DOI [DOI 10.1016/0022-1694(70)90255-6, 10.1016/0022-1694(70)90255-6, 10.1016/0022-1694]
[8]  
Pontius R.G.J., 2022, Metrics That Make a Difference, DOI DOI 10.1007/978-3-030-70765-1
[9]   Components of information for multiple resolution comparison between maps that share a real variable [J].
Pontius, Robert Gilmore, Jr. ;
Thontteh, Olufunmilayo ;
Chen, Hao .
ENVIRONMENTAL AND ECOLOGICAL STATISTICS, 2008, 15 (02) :111-142
[10]   Bias Correction of Paleoclimatic Reconstructions: A New Look at 1,200+Years of Upper Colorado River Flow [J].
Robeson, Scott M. ;
Maxwell, Justin T. ;
Ficklin, Darren L. .
GEOPHYSICAL RESEARCH LETTERS, 2020, 47 (01)