Ensemble Stochastic Configuration Networks for Estimating Prediction Intervals: A Simultaneous Robust Training Algorithm and Its Application

被引:76
作者
Lu, Jun [1 ]
Ding, Jinliang [1 ]
Dai, Xuewu [1 ]
Chai, Tianyou [1 ]
机构
[1] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Neural networks; Training; Robustness; Bayes methods; Stochastic processes; Prediction algorithms; Uncertainty; Bayesian ridge regression; bootstrap; ensemble stochastic configuration networks; m-estimate; prediction intervals; simultaneous robust training; UNCERTAINTIES; CONSTRUCTION;
D O I
10.1109/TNNLS.2020.2967816
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Obtaining accurate point prediction of industrial processes' key variables is challenging due to the outliers and noise that are common in industrial data. Hence the prediction intervals (PIs) have been widely adopted to quantify the uncertainty related to the point prediction. In order to improve the prediction accuracy and quantify the level of uncertainty associated with the point prediction, this article estimates the PIs by using ensemble stochastic configuration networks (SCNs) and bootstrap method. The estimated PIs can guarantee both the modeling stability and computational efficiency. To encourage the cooperation among the base SCNs and improve the robustness of the ensemble SCNs when the training data are contaminated with noise and outliers, a simultaneous robust training method of the ensemble SCNs is developed based on the Bayesian ridge regression and M-estimate. Moreover, the hyperparameters of the assumed distributions over noise and output weights of the ensemble SCNs are estimated by the expectation-maximization (EM) algorithm, which can result in the optimal PIs and better prediction accuracy. Finally, the performance of the proposed approach is evaluated on three benchmark data sets and a real-world data set collected from a refinery. The experimental results demonstrate that the proposed approach exhibits better performance in terms of the quality of PIs, prediction accuracy, and robustness.
引用
收藏
页码:5426 / 5440
页数:15
相关论文
共 37 条
[1]   Fast decorrelated neural network ensembles with random weights [J].
Alhamdoosh, Monther ;
Wang, Dianhui .
INFORMATION SCIENCES, 2014, 264 :104-117
[2]  
[Anonymous], 2018, Robust Statistics: Theory and Methods
[3]  
[Anonymous], 2015, IEEE T IND INFORM, DOI DOI 10.1109/TII.2015.2389625
[4]  
Bishop CM., 2006, Springer Google Schola, V2, P1122, DOI [10.5555/1162264, DOI 10.18637/JSS.V017.B05]
[5]   Particle size estimate of grinding processes using random vector functional link networks with improved robustness [J].
Dai, Wei ;
Liu, Qiang ;
Chai, Tianyou .
NEUROCOMPUTING, 2015, 169 :361-372
[6]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[7]  
Härdle WK, 2019, APPLIED MULTIVARIATE STATISTICAL ANALYSIS, 5TH EDITION, P107, DOI 10.1007/978-3-030-26006-4_4
[8]  
Heskes T, 1997, ADV NEUR IN, V9, P176
[9]   STOCHASTIC CHOICE OF BASIS FUNCTIONS IN ADAPTIVE FUNCTION APPROXIMATION AND THE FUNCTIONAL-LINK NET [J].
IGELNIK, B ;
PAO, YH .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (06) :1320-1329
[10]   A constructive algorithm for training cooperative neural network ensembles [J].
Islam, M ;
Yao, X ;
Murase, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (04) :820-834