Gaussian-PSO with fuzzy reasoning based on structural learning for training a Neural Network

被引:50
作者
Melo, Haydee [1 ]
Watada, Junzo [1 ]
机构
[1] Waseda Univ, Grad Sch Informat Prod & Syst, Dept Engn Management, Fukuoka, Japan
关键词
GPSO; PSO; Neural networks; Structural learning; Fuzzy reasoning; EVOLUTIONARY ALGORITHM; CONVERGENCE; RATES;
D O I
10.1016/j.neucom.2015.03.104
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes Gaussian-PSO-based structural learning and fuzzy reasoning to optimize the weights and the structure of the Feed Forward Neural Network. The Neural Network is widely used for various applications; though it still has disadvantages such as learning capability and slow convergence. Back Propagation, the most used learning algorithm, has several difficulties such as the necessity for a priori specification of the network structure and sensibility to parameter settings. Recently, research studies have introduced evolutionary algorithms into the learning to improve its performance. The PSO is a population-based algorithm that has the advantage of faster convergence. However, the total number of the weights in the Neural Network determines the size of each particle, therefore the size of the network structure is computationally time consuming. The proposed method improves the learning and removes the stress by eliminating the necessity of determining a detailed network. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:405 / 412
页数:8
相关论文
共 31 条
[1]  
Ahmad M., 1992, P INT C FUZZ LOG NEU
[2]   AN EVOLUTIONARY ALGORITHM THAT CONSTRUCTS RECURRENT NEURAL NETWORKS [J].
ANGELINE, PJ ;
SAUNDERS, GM ;
POLLACK, JB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (01) :54-65
[3]  
[Anonymous], 2000, J STAT SOFTW
[4]  
[Anonymous], NEURAL NETW
[5]  
[Anonymous], 1986, PARALLEL DISTRIBUTED
[6]  
[Anonymous], P OCEANS 92 MAST OC
[7]  
Arisawa M., 1997, Transactions of the Society of Instrument and Control Engineers, V33, P1087
[8]  
Cells M., 2002, The International Conference on Advances in Information Science and Soft Computing, P224
[9]  
Cerqueira J. J. F., 2002, 2002 IEEE International Conference on Systems, Man and Cybernetics. Conference Proceedings (Cat. No.02CH37349), DOI 10.1109/ICSMC.2002.1176108
[10]   Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks [J].
Gudise, VG ;
Venayagamoorthy, GK .
PROCEEDINGS OF THE 2003 IEEE SWARM INTELLIGENCE SYMPOSIUM (SIS 03), 2003, :110-117