Modified BBO-Based Multivariate Time-Series Prediction System With Feature Subset Selection and Model Parameter Optimization

被引:29
|
作者
Na, Xiaodong [1 ]
Han, Min [2 ]
Ren, Weijie [1 ]
Zhong, Kai [1 ]
机构
[1] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Minist Educ, Key Lab Intelligent Control & Optimizat Ind Equip, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Biogeography-based optimization (BBO); feature selection; multivariate time series; parameter optimization; prediction; BIOGEOGRAPHY-BASED OPTIMIZATION; ECHO STATE NETWORK; DIFFERENTIAL EVOLUTION; NEURAL-NETWORK; ALGORITHM; HYBRID; POPULATION;
D O I
10.1109/TCYB.2020.2977375
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multivariate time-series prediction is a challenging research topic in the field of time-series analysis and modeling, and is continually under research. The echo state network (ESN), a type of efficient recurrent neural network, has been widely used in time-series prediction, but when using ESN, two crucial problems have to be confronted: 1) how to select the optimal subset of input features and 2) how to set the suitable parameters of the model. To solve this problem, the modified biogeography-based optimization ESN (MBBO-ESN) system is proposed for system modeling and multivariate time-series prediction, which can simultaneously achieve feature subset selection and model parameter optimization. The proposed MBBO algorithm is an improved evolutionary algorithm based on biogeography-based optimization (BBO), which utilizes an S-type population migration rate model, a covariance matrix migration strategy, and a Levy distribution mutation strategy to enhance the rotation invariance and exploration ability. Furthermore, the MBBO algorithm cannot only optimize the key parameters of the ESN model but also uses a hybrid-metric feature selection method to remove the redundancies and distinguish the importance of the input features. Compared with the traditional methods, the proposed MBBO-ESN system can discover the relationship between the input features and the model parameters automatically and make the prediction more accurate. The experimental results on the benchmark and real-world datasets demonstrate that MBBO outperforms the other traditional evolutionary algorithms, and the MBBO-ESN system is more competitive in multivariate time-series prediction than other classic machine-learning models.
引用
收藏
页码:2163 / 2173
页数:11
相关论文
共 50 条
  • [1] Nonlinear time series prediction using modified BBO-based trained TDCMAC network
    Mao, Wei-Lung
    Suprapto
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (06) : 6199 - 6215
  • [2] Feature subset selection and feature ranking for multivariate time series
    Yoon, H
    Yang, KY
    Shahabi, C
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2005, 17 (09) : 1186 - 1198
  • [3] Multivariate Time Series Predictor With Parameter Optimization and Feature Selection Based on Modified Binary Salp Swarm Algorithm
    Ren, Weijie
    Ma, Dewei
    Han, Min
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (04) : 6150 - 6159
  • [4] Mutual information based feature subset selection in multivariate time series classification
    Ircio, Josu
    Lojo, Aizea
    Mori, Usue
    Lozano, Jose A.
    PATTERN RECOGNITION, 2020, 108 (108)
  • [5] Feature selection for change detection in multivariate time-series
    Botsch, Michael
    Nossek, Josef A.
    2007 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, VOLS 1 AND 2, 2007, : 590 - 597
  • [6] CLeVer:: A feature subset selection technique for multivariate time series
    Yang, KY
    Yoon, H
    Shahabi, C
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PROCEEDINGS, 2005, 3518 : 516 - 522
  • [7] Temporal Feature Selection for Time-series Prediction
    Hido, Shohei
    Morimura, Tetsuro
    2012 21ST INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR 2012), 2012, : 3557 - 3560
  • [8] Mutual Information with Parameter Determination Approach for Feature Selection in Multivariate Time Series Prediction
    Liu, Tianhong
    Wei, Haikun
    Zhang, Chi
    Zhang, Kanjian
    ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EANN 2016, 2016, 629 : 227 - 237
  • [9] Feature subset selection on multivariate time series with extremely large spatial features
    Yoon, Hyunjin
    Shahabi, Cyrus
    ICDM 2006: SIXTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, WORKSHOPS, 2006, : 337 - +
  • [10] Feature Selection for Time-Series Prediction in Case of Undetermined Estimation
    Sergii, Khmilovyi
    Yurii, Skobtsov
    Tatyana, Vasyaeva
    Natalia, Andrievskaya
    BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES (BICA) FOR YOUNG SCIENTISTS, 2016, 449 : 85 - 97