A hybrid approach for training recurrent neural networks: application to multi-step-ahead prediction of noisy and large data sets

被引:9
作者
Chtourou, S. [1 ]
Chtourou, M. [1 ]
Hammami, O. [2 ]
机构
[1] ENIS, Natl Sch Engn Sfax, Intelligent Control Design & Optimizat Complex, Sfax 3038, Tunisia
[2] ENSTA, Unite Elect & Informat, F-75015 Paris, France
关键词
RNN; noisy and large data set; memory addresses prediction; SOM; back-propagation through time;
D O I
10.1007/s00521-007-0116-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Noisy and large data sets are extremely difficult to handle and especially to predict. Time series prediction is a problem, which is frequently addressed by researchers in many engineering fields. This paper presents a hybrid approach to handle a large and noisy data set. In fact, a Self Organizing Map (SOM), combined with multiple recurrent neural networks (RNN) has been trained to predict the components of noisy and large data set. The SOM has been developed to construct incrementally a set of clusters. Each cluster has been represented by a subset of data used to train a recurrent neural network. The back propagation through time has been deployed to train the set of recurrent neural networks. To show the performances of the proposed approach, a problem of instruction addresses prefetching has been treated.
引用
收藏
页码:245 / 254
页数:10
相关论文
共 27 条
[1]   New results on recurrent network training: Unifying the algorithms and accelerating convergence [J].
Atiya, AF ;
Parlos, AG .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (03) :697-709
[2]   Incremental training of first order recurrent neural networks to predict a context-sensitive language [J].
Chalup, SK ;
Blair, AD .
NEURAL NETWORKS, 2003, 16 (07) :955-972
[3]   Radial basis function based adaptive fuzzy systems and their applications to system identification and prediction [J].
Cho, KB ;
Wang, BH .
FUZZY SETS AND SYSTEMS, 1996, 83 (03) :325-339
[4]  
CHTOUROU S, 2006, P INT JOINT C NEUR N, P5130
[5]   RECURRENT NEURAL NETWORKS AND ROBUST TIME-SERIES PREDICTION [J].
CONNOR, JT ;
MARTIN, RD ;
ATLAS, LE .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :240-254
[6]  
Deshpande M., 2004, ACM T INTERNET TECHN, V4, P163, DOI DOI 10.1145/990301.990304
[7]   The growing hierarchical self-organizing map [J].
Dittenbach, M ;
Merkl, D ;
Rauber, A .
IJCNN 2000: PROCEEDINGS OF THE IEEE-INNS-ENNS INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOL VI, 2000, :15-19
[8]   Noisy time series prediction using recurrent neural networks and grammatical inference [J].
Giles, CL ;
Lawrence, S ;
Tsoi, AC .
MACHINE LEARNING, 2001, 44 (1-2) :161-183
[9]  
Hammond J, 2006, IEEE IJCNN, P958
[10]   A comparative study of neural network and Box-Jenkins ARIMA modeling in time series prediction [J].
Ho, SL ;
Xie, M ;
Goh, TN .
COMPUTERS & INDUSTRIAL ENGINEERING, 2002, 42 (2-4) :371-375