An improved extreme learning machine for classification problem based on affinity propagation clustering

被引:0
作者
Wu, Xinjie [1 ]
机构
[1] School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu
关键词
Affinity propagation; Classification; Extreme learning machine; Feedforward neural networks;
D O I
10.4156/ijact.vol4.issue10.32
中图分类号
学科分类号
摘要
Extreme learning machine (ELM) is an efficient algorithm for single-hidden layer feedforward neural networks (SLFNs), which can produce good generalization performance in most cases and learn thousands of times faster than conventional popular algorithms. However, the performance of ELM is sensitive to the initialized number of hidden neurons. In some traditional methods, the number of hidden nodes is gradually increased by a fixed interval to select the nearly optimal number of nodes for ELM, whereas these methods are of a little bit of complexity and quite time-consuming. This paper proposes an improved ELM based on the affinity propagation clustering, which does not need to define the number of hidden nodes in advance manually and randomly. The proposed algorithm automatically determines the number of hidden nodes for different data sets. Empirical study of AP-based ELM on several commonly used classification benchmark problems shows that it achieves better performance compared with the standard ELM.
引用
收藏
页码:274 / 280
页数:6
相关论文
共 14 条
[1]  
Ng S.-C., Cheung C.-C., Leung S.-H., Magnified Gradient Function with Deterministic Weight Modification in Adaptive Learning, IEEE Transactions On Neural Networks, 15, 6, pp. 1411-1423, (2004)
[2]  
Ding S.-F., Ma G., Xin-Zheng X., A Rough RBF Neural Networks Optimized by the Genetic Algorithm, AISS: Advances In Information Sciences and Service Sciences, 3, 7, pp. 332-339, (2011)
[3]  
Ding S.-F., Jia W.-K., Chun-Yang S., Liu X.-L., Chen J.-R., An Improved BP Neural Network Algorithm Based on Factor Analysis, JCIT: Journal of Convergence Information Technology, 5, 4, pp. 103-108, (2010)
[4]  
Huang G.-B., Zhu Q.-Y., Siew C.-K., Extreme Learning Machine: Theory and Applications, Neurocomputing, 70, 1-3, pp. 489-501, (2006)
[5]  
Sun Z.-L., Choi T.-M., Kin-Fan A., Yong Y., Sales Forecasting Using Extreme Learning Machine with Applications in Fashion Retailing, Decision Support Systems, 46, 1, pp. 411-419, (2008)
[6]  
Wang G.-R., Yi Z., Di W., A Protein Secondary Structure Prediction Frame-work Based on the Extreme Learning Machine, Neurocomputing, 72, 1-3, pp. 262-268, (2008)
[7]  
Malathi V., Marimuthu N., Baskar S., Intelligent Approaches Using Support Vector Machine and Extreme Learning Machine for Transmission Line Protection, Neurocomputing, 73, 10-12, pp. 2160-2167, (2010)
[8]  
Minhas R., Baradarani A., Seifzadeh S., Wu Q.J., Human Action Recognition Using Extreme Learning Machine Based on Visual Vocabularies, Neurocomputing, 73, 10-12, pp. 1906-1917, (2010)
[9]  
Frey B.J., Dueck D., Clustering by Passing Messages between Data Points, Science, 315, 5814, pp. 972-976, (2007)
[10]  
Estivill-Castro V., Yang J., Fast and Robust General Purpose Clustering Algorithms, Data Mining and Knowledge Discovery, 8, 2, pp. 127-150, (2004)