Error-Driven Chained Multiple-Subnetwork Echo State Network for Time-Series Prediction

被引:10
作者
Huang, Jian [1 ]
Li, Yiran [1 ]
Shardt, Yuri A. W. [2 ]
Qiao, Liang [1 ]
Shi, Mingrui [1 ]
Yang, Xu [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
[2] Tech Univ Ilmenau, Dept Automat Engn, D-98684 Ilmenau, Germany
基金
北京市自然科学基金;
关键词
Reservoirs; Predictive models; Time series analysis; Topology; Optimization; Computational modeling; Training; Echo state network (ESN); error-driven chain topology; multiple subnetworks; time-series prediction; CYCLE RESERVOIR NETWORK; OPTIMIZATION; MULTISTEP; PROPERTY; DESIGN;
D O I
10.1109/JSEN.2022.3200069
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hybrid echo state networks (ESNs), a type of modified ESN, have been developed to improve the prediction accuracy of ESNs. However, they have been criticized for their computational complexity, which makes it difficult to use them directly in industrial applications. In this article, an error-driven chained multiple-subnetwork ESN (CESN) is proposed to build a simple structured hybrid network and improve its prediction accuracy. For this reason, a chain topology is generated to gradually reduce the residual error, while each subnetwork is trained separately. The weight matrix for each subnetwork does not need to be optimized, which reduces the computational cost. Meanwhile, the optimal number of subnetworks is determined on the basis of a given application. The efficiency of the proposed CESN is tested on a Santa Fe Laser and a public building dataset. Compared with ESN, 70% of the test data have been optimized by CESN for the public building dataset.
引用
收藏
页码:19533 / 19542
页数:10
相关论文
共 28 条
[1]   PSO-MISMO Modeling Strategy for MultiStep-Ahead Time Series Prediction [J].
Bao, Yukun ;
Xiong, Tao ;
Hu, Zhongyi .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (05) :655-668
[2]   Echo State Network-Based Backstepping Adaptive Iterative Learning Control for Strict-Feedback Systems: An Error-Tracking Approach [J].
Chen, Qiang ;
Shi, Huihui ;
Sun, Mingxuan .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) :3009-3022
[3]   A novel combined model based on echo state network for multi-step ahead wind speed forecasting: A case study of NREL [J].
Chen, Yanhua ;
He, Zhaoshuang ;
Shang, Zhihao ;
Li, Caihong ;
Li, Lian ;
Xu, Mingliang .
ENERGY CONVERSION AND MANAGEMENT, 2019, 179 :13-29
[4]   PSO-based analysis of Echo State Network parameters for time series forecasting [J].
Chouikhi, Naima ;
Ammar, Boudour ;
Rokbani, Nizar ;
Alimi, Adel M. .
APPLIED SOFT COMPUTING, 2017, 55 :211-225
[5]   An approach to reservoir computing design and training [J].
Ferreira, Aida A. ;
Ludermir, Teresa B. ;
de Aquino, Ronaldo R. B. .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (10) :4172-4182
[6]   A hierarchical optimization neural network for large-scale dynamic systems [J].
Hou, ZG .
AUTOMATICA, 2001, 37 (12) :1931-1940
[7]   Effective energy consumption forecasting using enhanced bagged echo state network [J].
Hu, Huanling ;
Wang, Lin ;
Peng, Lu ;
Zeng, Yu-Rong .
ENERGY, 2020, 193 :531-546
[8]   A new wind power interval prediction approach based on reservoir computing and a quality-driven loss function [J].
Hu, Jianming ;
Lin, Yingying ;
Tang, Jingwei ;
Zhao, Jing .
APPLIED SOFT COMPUTING, 2020, 92
[9]   Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication [J].
Jaeger, H ;
Haas, H .
SCIENCE, 2004, 304 (5667) :78-80
[10]   Optimization and applications of echo state networks with leaky-integrator neurons [J].
Jaegera, Herbert ;
Lukosevicius, Mantas ;
Popovici, Dan ;
Siewert, Udo .
NEURAL NETWORKS, 2007, 20 (03) :335-352