Modified BBO-Based Multivariate Time-Series Prediction System With Feature Subset Selection and Model Parameter Optimization

被引:32
作者
Na, Xiaodong [1 ]
Han, Min [2 ]
Ren, Weijie [1 ]
Zhong, Kai [1 ]
机构
[1] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Minist Educ, Key Lab Intelligent Control & Optimizat Ind Equip, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Biogeography-based optimization (BBO); feature selection; multivariate time series; parameter optimization; prediction; BIOGEOGRAPHY-BASED OPTIMIZATION; ECHO STATE NETWORK; DIFFERENTIAL EVOLUTION; NEURAL-NETWORK; ALGORITHM; HYBRID; POPULATION;
D O I
10.1109/TCYB.2020.2977375
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multivariate time-series prediction is a challenging research topic in the field of time-series analysis and modeling, and is continually under research. The echo state network (ESN), a type of efficient recurrent neural network, has been widely used in time-series prediction, but when using ESN, two crucial problems have to be confronted: 1) how to select the optimal subset of input features and 2) how to set the suitable parameters of the model. To solve this problem, the modified biogeography-based optimization ESN (MBBO-ESN) system is proposed for system modeling and multivariate time-series prediction, which can simultaneously achieve feature subset selection and model parameter optimization. The proposed MBBO algorithm is an improved evolutionary algorithm based on biogeography-based optimization (BBO), which utilizes an S-type population migration rate model, a covariance matrix migration strategy, and a Levy distribution mutation strategy to enhance the rotation invariance and exploration ability. Furthermore, the MBBO algorithm cannot only optimize the key parameters of the ESN model but also uses a hybrid-metric feature selection method to remove the redundancies and distinguish the importance of the input features. Compared with the traditional methods, the proposed MBBO-ESN system can discover the relationship between the input features and the model parameters automatically and make the prediction more accurate. The experimental results on the benchmark and real-world datasets demonstrate that MBBO outperforms the other traditional evolutionary algorithms, and the MBBO-ESN system is more competitive in multivariate time-series prediction than other classic machine-learning models.
引用
收藏
页码:2163 / 2173
页数:11
相关论文
共 44 条
[1]   Wrapper ANFIS-ICA method to do stock market timing and feature selection on the basis of Japanese Candlestick [J].
Barak, Sasan ;
Dahooie, Jalil Heidary ;
Tichy, Tomas .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (23) :9221-9235
[2]   Prediction of telephone calls load using Echo State Network with exogenous variables [J].
Bianchi, Filippo Maria ;
Scardapane, Simone ;
Uncini, Aurelio ;
Rizzi, Antonello ;
Sadeghian, Alireza .
NEURAL NETWORKS, 2015, 71 :204-213
[3]   Wind speed and wind direction forecasting using echo state network with nonlinear functions [J].
Chitsazan, Mohammad Amin ;
Fadali, M. Sami ;
Trzynadlowski, Andrzej M. .
RENEWABLE ENERGY, 2019, 131 :879-889
[4]   Self-adaptive differential evolution for feature selection in hyperspectral image data [J].
Ghosh, Ashish ;
Datta, Aloke ;
Ghosh, Susmita .
APPLIED SOFT COMPUTING, 2013, 13 (04) :1969-1977
[5]   A real-coded biogeography-based optimization with mutation [J].
Gong, Wenyin ;
Cai, Zhihua ;
Ling, Charles X. ;
Li, Hui .
APPLIED MATHEMATICS AND COMPUTATION, 2010, 216 (09) :2749-2758
[6]   Enhancing Differential Evolution Utilizing Eigenvector-Based Crossover Operator [J].
Guo, Shu-Mei ;
Yang, Chin-Chang .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2015, 19 (01) :31-49
[7]   Interval Type-2 Fuzzy Neural Networks for Chaotic Time Series Prediction: A Concise Overview [J].
Han, Min ;
Zhong, Kai ;
Qiu, Tie ;
Han, Bing .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (07) :2720-2731
[8]   Completely derandomized self-adaptation in evolution strategies [J].
Hansen, N ;
Ostermeier, A .
EVOLUTIONARY COMPUTATION, 2001, 9 (02) :159-195
[9]   Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication [J].
Jaeger, H ;
Haas, H .
SCIENCE, 2004, 304 (5667) :78-80
[10]   Modified genetic algorithm-based feature selection combined with pre-trained deep neural network for demand forecasting in outpatient department [J].
Jiang, Shancheng ;
Chin, Kwai-Sang ;
Wang, Long ;
Qu, Gang ;
Tsui, Kwok L. .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 82 :216-230