Robust multilayer neural network based on median neuron model

被引:0
作者
Cagdas Hakan Aladag
Erol Egrioglu
Ufuk Yolcu
机构
[1] Hacettepe University,Department of Statistics, Faculty of Science
[2] Ondokuz Mayis University,Department of Statistics, Faculty of Arts and Science
[3] Giresun University,Department of Statistics, Faculty of Art and Science
来源
Neural Computing and Applications | 2014年 / 24卷
关键词
Feed forward; Forecasting; Median neuron model; Particle swarm optimization; Robust neural networks; Outlier;
D O I
暂无
中图分类号
学科分类号
摘要
Multilayer perceptron has been widely used in time series forecasting for last two decades. However, it is a well-known fact that the forecasting performance of multilayer perceptron is negatively affected when data have outliers and this is an important problem. In recent years, some alternative neuron models such as generalized-mean neuron, geometric mean neuron, and single multiplicative neuron have been also proposed in the literature. However, it is expected that forecasting performance of artificial neural network approaches based on these neuron models can be also negatively affected by outliers since the aggregation function employed in these models is based on mean value. In this study, a new multilayer feed forward neural network, which is called median neuron model multilayer feed forward (MNM-MFF) model, is proposed in order to deal with this problem caused by outliers and to reach high accuracy level. In the proposed model, unlike other models suggested in the literature, MNM which has median-based aggregation function is employed. MNM is also firstly defined in this study. MNM-MFF is a robust neural network method since aggregation functions in MNM-MFF are based on median, which is not affected much by outliers. In addition, to train MNM-MFF model, particle swarm optimization method was utilized. MNM-MFF was applied to two well-known time series in order to evaluate the performance of the proposed approach. As a result of the implementation, it was observed that the proposed MNM-MFF model has high forecasting accuracy and it is not affected by outlier as much as multilayer perceptron model. Proposed method brings improvement in 7 % for data without outlier, in 90 % for data with outlier, in 95 % for data with bigger outlier.
引用
收藏
页码:945 / 956
页数:11
相关论文
共 54 条
[1]  
Aladag CH(2012)A new time invariant fuzzy time series forecasting method based on particle swarm optimization Appl Soft Comput 12 3291-3299
[2]  
Egrioglu E(2010)Forecast combination by using artificial neural networks Neural Process Lett 32 269-276
[3]  
Yolcu U(2009)Forecasting nonlinear time series with a hybrid methodology Appl Math Lett 22 1467-1470
[4]  
Dalar AZ(2004)Improved generalized neuron model for short-term load forecasting Soft Comput 8 370-379
[5]  
Aladag CH(1987)Learning invariance and generalization in higher order networks Appl Opt 26 4972-4978
[6]  
Egrioglu E(1994)Artificial neural networks for forecasting and decision making Int J Forecast 10 5-15
[7]  
Yolcu U(2002)Generalized second-order neural unit Bull Coll Med Sci Tohoku Univ 11 1-6
[8]  
Aladag CH(2006)The formulation of the optimal strategies for the electricity producers based on the particle swarm optimization algorithm IEEE Trans Power Syst 21 1663-1671
[9]  
Egrioglu E(1943)A logical calculus of the ideas immanent in nervous activity Bull Math Biophys 5 115-133
[10]  
Kadilar C(2000)Randomly connected sigma–pi neurons can form associator networks NETCNS Netw Comput Neural Syst 11 321-322