Maximum Information Exploitation Using Broad Learning System for Large-Scale Chaotic Time-Series Prediction

被引:38
作者
Han, Min [1 ]
Li, Weijie [2 ]
Feng, Shoubo [2 ]
Qiu, Tie [3 ]
Chen, C. L. Philip [4 ,5 ,6 ]
机构
[1] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equip, Minist Educ, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Fac Elect Informat & Elect Engn, Dalian 116024, Peoples R China
[3] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
[4] Univ Macau, Fac Sci & Technol, Dept Comp & Informat Sci, Macau, Peoples R China
[5] Dalian Maritime Univ, Nav Coll, Dalian 116026, Peoples R China
[6] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100080, Peoples R China
基金
中国国家自然科学基金;
关键词
Reservoirs; Time series analysis; Feature extraction; Learning systems; Neural networks; Data mining; Manifolds; Broad learning system (BLS); chaotic time series; feature reactivation; maximum information exploitation (MIE); prediction; RANDOM PROJECTIONS; NONLINEARITY; MODEL;
D O I
10.1109/TNNLS.2020.3004253
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
How to make full use of the evolution information of chaotic systems for time-series prediction is a difficult issue in dynamical system modeling. In this article, we propose a maximum information exploitation broad learning system (MIE-BLS) for extreme information utilization of large-scale chaotic time-series modeling. An improved leaky integrator dynamical reservoir is introduced in order to capture the linear information of chaotic systems effectively. It can not only capture the information of the current state but also achieve the compromise with historical states in the dynamical system. Furthermore, the feature is mapped to the enhancement layer by nonlinear random mapping to exploit nonlinear information. The cascading mechanism promotes the information propagation and achieves feature reactivation in dynamical modeling. Discussions about maximum information exploration and the comparisons with ResNet, DenseNet, and HighwayNet are presented in this article. Simulation results on four large-scale data sets illustrate that MIE-BLS could achieve better performance of information exploration in large-scale dynamical system modeling.
引用
收藏
页码:2320 / 2329
页数:10
相关论文
共 45 条
[1]   Database-friendly random projections: Johnson-Lindenstrauss with binary coins [J].
Achlioptas, D .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2003, 66 (04) :671-687
[2]   Two Machine Learning Approaches for Short-Term Wind Speed Time-Series Prediction [J].
Ak, Ronay ;
Fink, Olga ;
Zio, Enrico .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (08) :1734-1747
[3]  
[Anonymous], 2016, P BRIT MACH VIS C BM
[4]  
[Anonymous], 2017, stat
[5]   Near-optimal signal recovery from random projections: Universal encoding strategies? [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) :5406-5425
[6]   Universal Approximation Capability of Broad Learning System and Its Structural Variations [J].
Chen, C. L. Philip ;
Liu, Zhulin ;
Feng, Shuang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (04) :1191-1204
[7]   Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture [J].
Chen, C. L. Philip ;
Liu, Zhulin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (01) :10-24
[8]   Temporal Attention-Augmented Bilinear Network for Financial Time-Series Data Analysis [J].
Dat Thanh Tran ;
Iosifidis, Alexandros ;
Kanniainen, Juho ;
Gabbouj, Moncef .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (05) :1407-1418
[9]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[10]  
Fahlman S. E., 1990, ADV NEURAL INFORMATI, V2, P524