Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals

被引:570
作者
Khosravi, Abbas [1 ]
Nahavandi, Saeid [1 ]
Creighton, Doug [1 ]
Atiya, Amir F. [2 ]
机构
[1] Deakin Univ, Ctr Intelligent Syst Res, Geelong, Vic 3117, Australia
[2] Cairo Univ, Dept Comp Engn, Cairo 12613, Egypt
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2011年 / 22卷 / 03期
关键词
Neural network; prediction interval; simulated annealing; uncertainty; TIME-SERIES; CONFIDENCE; BOOTSTRAP; MODELS; REGRESSION;
D O I
10.1109/TNN.2010.2096824
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Prediction intervals (PIs) have been proposed in the literature to provide more information by quantifying the level of uncertainty associated to the point forecasts. Traditional methods for construction of neural network (NN) based PIs suffer from restrictive assumptions about data distribution and massive computational loads. In this paper, we propose a new, fast, yet reliable method for the construction of PIs for NN predictions. The proposed lower upper bound estimation (LUBE) method constructs an NN with two outputs for estimating the prediction interval bounds. NN training is achieved through the minimization of a proposed PI-based objective function, which covers both interval width and coverage probability. The method does not require any information about the upper and lower bounds of PIs for training the NN. The simulated annealing method is applied for minimization of the cost function and adjustment of NN parameters. The demonstrated results for 10 benchmark regression case studies clearly show the LUBE method to be capable of generating high-quality PIs in a short time. Also, the quantitative comparison with three traditional techniques for prediction interval construction reveals that the LUBE method is simpler, faster, and more reliable.
引用
收藏
页码:337 / 346
页数:10
相关论文
共 37 条
  • [1] Aarts E., 1989, Simulated annealing and Boltzmann machines: a stochastic approach to combinatorial optimization and neural computing
  • [2] [Anonymous], 1989, NONLINEAR REGRESSION
  • [3] Benefits of quantile regression for the analysis of customer lifetime value in a contractual setting: An application in financial services
    Benoit, Dries F.
    Van den Poel, Dirk
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (07) : 10475 - 10484
  • [4] Bishop CM., 1995, NEURAL NETWORKS PATT
  • [5] CARNEY JG, 1999, P IJCNN 99 C, V2, P1215
  • [6] Confidence interval prediction for neural network models
    Chryssolouris, G
    Lee, M
    Ramsey, A
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (01): : 229 - 232
  • [7] 25 years of time series forecasting
    De Gooijer, Jan G.
    Hyndman, Rob J.
    [J]. INTERNATIONAL JOURNAL OF FORECASTING, 2006, 22 (03) : 443 - 473
  • [8] Prediction intervals for neural networks via nonlinear regression
    De Veaux, RD
    Schumi, J
    Schweinsberg, J
    Ungar, LH
    [J]. TECHNOMETRICS, 1998, 40 (04) : 273 - 282
  • [9] DEMOOR B, 2010, DAISY DATABASE IDENT
  • [10] Backpropagation of pseudoerrors: Neural networks that are adaptive to heterogeneous noise
    Ding, ADA
    He, XL
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (02): : 253 - 262