Genetic algorithm optimized double-reservoir echo state network for multi-regime time series prediction

被引:85
作者
Zhong, Shisheng [1 ]
Xie, Xiaolong [1 ]
Lin, Lin [1 ]
Wang, Fang [1 ]
机构
[1] Harbin Inst Technol, Sch Mechatron Engn, Harbin, Peoples R China
基金
国家高技术研究发展计划(863计划); 中国国家自然科学基金;
关键词
Echo state network; Multi-regime time series; Time series prediction; Genetic algorithm; PARTICLE SWARM OPTIMIZATION; EXTREME LEARNING-MACHINE; PROGNOSTICS; SYSTEM; MODELS;
D O I
10.1016/j.neucom.2017.01.053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In prognostics and health management (PHM), the sensor measurement time series of equipment is collected, and predicting future sensor measurements accurately is crucial to PHM. Complex equipment is generally operated under dynamic operational conditions; thus, operational regime-switching process exists in the sensor measurement time series, which is called multi-regime time series. Different operational regimes may have various effects on time series; thus, the regime-switching process poses great challenge for multi-regime time series prediction. To predict the multi-regime time series accurately, the double-reservoir echo state network (DRESN) is adopted by modifying the conventional echo state network. The DRESN model has two input sequences: the sensor measurement sequence and regime parameter sequence, where the regime parameter reflects the operational regimes and influences sensor measurement; then, two reservoirs try to model these two sequences, respectively; last, the outputs of two reservoirs are aggregated to predict the future sensor measurement. The DRESN model not only considers previous sensor measurements but also takes the influence of regime parameters into account when predicting future sensor measurement; thus, it can improve the accuracy of multi-regime time series prediction. In addition, the training algorithm of the DRESN model is presented and only a linear regression problem needs to be solved, making the DRESN model efficient. To achieve good performance, four parameters of the DRESN model are optimized using genetic algorithm (GA) because GA is effective in solving mixed-integer problem, and the weighted cross validation is adopted in the objective function to achieve the accuracy and simplicity simultaneously. The DRESN model is applied to turbofan engine multi-regime time series and compared with other models. The results validate that the DRESN model can be accurate and stable in multi-regime time series prediction. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:191 / 204
页数:14
相关论文
共 54 条
[1]  
[Anonymous], 2007, Scholarpedia, DOI DOI 10.4249/SCHOLARPEDIA.2330
[2]  
[Anonymous], 2001, GMD Report 148
[3]   A Kalman Filter-Based Ensemble Approach With Application to Turbine Creep Prognostics [J].
Baraldi, Piero ;
Mangili, Francesca ;
Zio, Enrico .
IEEE TRANSACTIONS ON RELIABILITY, 2012, 61 (04) :966-977
[4]   Selecting and weighting features using a genetic algorithm in a case-based reasoning approach to personnel rostering [J].
Beddoe, Gareth R. ;
Petrovic, Sanja .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2006, 175 (02) :649-671
[5]   Reservoir computing and extreme learning machines for non-linear time-series data analysis [J].
Butcher, J. B. ;
Verstraeten, D. ;
Schrauwen, B. ;
Day, C. R. ;
Haycock, P. W. .
NEURAL NETWORKS, 2013, 38 :76-89
[6]   Comparison of genetic and binary particle swarm optimization algorithms on system maintenance scheduling using prognostics information [J].
Camci, Fatih .
ENGINEERING OPTIMIZATION, 2009, 41 (02) :119-136
[7]   LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[8]   Predicting m-commerce adoption determinants: A neural network approach [J].
Chong, Alain Yee-Loong .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (02) :523-530
[9]  
Coelho LD, 2011, IEEE C EVOL COMPUTAT, P517
[10]   An efficient particle swarm approach for mixed-integer programming in reliability-redundancy optimization applications [J].
Coelho, Leandro dos Santos .
RELIABILITY ENGINEERING & SYSTEM SAFETY, 2009, 94 (04) :830-837