Tuning the structure and parameters of a neural network using cooperative binary-real particle swarm optimization

被引:33
作者
Zhao, Liang [1 ]
Qian, Feng [1 ]
机构
[1] E China Univ Sci & Technol, Key Lab Adv Control & Optimizat Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
基金
中国国家自然科学基金;
关键词
Particle swarm optimization; Neural network; Cooperative; PSO;
D O I
10.1016/j.eswa.2010.09.154
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a cooperative binary-real particle swarm optimization is applied to tune the structure and parameters of a neural network. A neural network with switches of its links, which is used to decide whether there is a link between two neurons or not, is introduced firstly. Thus, the structure of a neural network can be decided by the switches. A cooperative binary-real particle swarm optimization algorithm is utilized to find the compact structures and optimal parameters of the proposed neural network. The number of hidden nodes of the neural network is increased from a small number until its learning ability is achieved. The simulation experiments indicate that the proposed approach can obtain better results than the existing approaches in recent literature. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码:4972 / 4977
页数:6
相关论文
共 26 条
[1]  
Brown M., 1994, Neural Fuzzy Adaptive Modeling and Control
[2]   Evolutionary learning of modular neural networks with genetic programming [J].
Cho, SB ;
Shimohara, K .
APPLIED INTELLIGENCE, 1998, 9 (03) :191-200
[3]  
Eberhart R., 1995, MHS 95, P39, DOI [DOI 10.1109/MHS.1995.494215, 10.1109/MHS.1995.494215]
[4]  
El-Abd M, 2006, STUD COMP INTELL, V31, P239
[5]   COVNET:: A cooperative coevolutionary model for evolving artificial neural networks [J].
García-Pedrajas, N ;
Hervág-Martínez, C ;
Muñoz-Pérez, J .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (03) :575-596
[6]   MULTILAYER FEEDFORWARD NETWORKS ARE UNIVERSAL APPROXIMATORS [J].
HORNIK, K ;
STINCHCOMBE, M ;
WHITE, H .
NEURAL NETWORKS, 1989, 2 (05) :359-366
[7]   Adaptive image interpolation using probabilistic neural network [J].
Hsieh, Sheng-Hsien ;
Chen, Ching-Han .
EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (03) :6025-6029
[8]   A Hybri of genetic algorithm and particle swarm optimization for recurrent network design [J].
Juang, CF .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (02) :997-1006
[9]  
Kennedy J, 1997, IEEE SYS MAN CYBERN, P4104, DOI 10.1109/ICSMC.1997.637339
[10]  
Kennedy J, 1995, 1995 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS PROCEEDINGS, VOLS 1-6, P1942, DOI 10.1109/icnn.1995.488968