Prediction Intervals for a Noisy Nonlinear Time Series Based on a Bootstrapping Reservoir Computing Network Ensemble

被引:56
作者
Sheng, Chunyang [1 ]
Zhao, Jun [1 ]
Wang, Wei [1 ]
Leung, Henry [2 ]
机构
[1] Dalian Univ Technol, Res Ctr Informat & Control, Dalian 116023, Peoples R China
[2] Univ Calgary, Dept Elect & Comp Engn, Calgary, AB T2N 1N4, Canada
关键词
Bootstrap; network ensemble; noisy nonlinear time series; prediction intervals (PIs); reservoir computing networks (RCNs); CROSS-VALIDATION; NEURAL-NETWORKS; CONFIDENCE; ENERGY;
D O I
10.1109/TNNLS.2013.2250299
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Prediction intervals that provide estimated values as well as the corresponding reliability are applied to nonlinear time series forecast. However, constructing reliable prediction intervals for noisy time series is still a challenge. In this paper, a bootstrapping reservoir computing network ensemble (BRCNE) is proposed and a simultaneous training method based on Bayesian linear regression is developed. In addition, the structural parameters of the BRCNE, that is, the number of reservoir computing networks and the reservoir dimension, are determined off-line by the 0.632 bootstrap cross-validation. To verify the effectiveness of the proposed method, two kinds of time series data, including the multisuperimposed oscillator problem with additive noises and a practical gas flow in steel industry are employed here. The experimental results indicate that the proposed approach has a satisfactory performance on prediction intervals for practical applications.
引用
收藏
页码:1036 / 1048
页数:13
相关论文
共 31 条
  • [1] In-Sample and Out-of-Sample Model Selection and Error Estimation for Support Vector Machines
    Anguita, Davide
    Ghio, Alessandro
    Oneto, Luca
    Ridella, Sandro
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (09) : 1390 - 1406
  • [2] [Anonymous], 1993, An introduction to the bootstrap
  • [3] [Anonymous], 2002, approach
  • [4] A survey of cross-validation procedures for model selection
    Arlot, Sylvain
    Celisse, Alain
    [J]. STATISTICS SURVEYS, 2010, 4 : 40 - 79
  • [5] On the use of cross-validation for time series predictor evaluation
    Bergmeir, Christoph
    Benitez, Jose M.
    [J]. INFORMATION SCIENCES, 2012, 191 : 192 - 213
  • [6] Bishop CM., 1995, NEURAL NETWORKS PATT
  • [7] Approximate Confidence and Prediction Intervals for Least Squares Support Vector Regression
    De Brabanter, Kris
    De Brabanter, Jos
    Suykens, Johan A. K.
    De Moor, Bart
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (01): : 110 - 120
  • [8] Improvements on cross-validation: The .632+ bootstrap method
    Efron, B
    Tibshirani, R
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1997, 92 (438) : 548 - 560
  • [9] EFRON B, 1995, TR477 STANF U DEP ST
  • [10] Heskes T, 1997, ADV NEUR IN, V9, P176