Self-organizing and self-evolving neurons: A new neural network for optimization

被引:38
作者
Wu, Sitao [1 ]
Chow, Tommy W. S. [1 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Kowloon, Hong Kong, Peoples R China
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2007年 / 18卷 / 02期
关键词
particle swarm optimization (PSO); self-organizing and self-evolving neurons (SOSENs); self-organizing map (SOM); simulated annealing;
D O I
10.1109/TNN.2006.887556
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A self-organizing and self-evolving agents (SOSENs) neural network is proposed. Each neuron of the SOSENs evolves itself with a simulated annealing (SA) algorithm. The self-evolving behavior of each neuron is a local improvement that results in speeding up the convergence. The chance of reaching the global optimum is increased because multiple SAs are run in a searching space. Optimum results obtained by the SOSENs are better in average than those obtained by a single SA. Experimental results show that the SOSENs have less temperature changes than the SA to reach the global minimum. Every neuron exhibits a self-organizing behavior, which is similar to those of the self-organizing map (SOM), particle swarm optimization (PSO), and self-organizing migrating algorithm (SOMA). At last, the computational time of parallel SOSENs can be less than the SA.
引用
收藏
页码:385 / 396
页数:12
相关论文
共 50 条
[1]   A DISTRIBUTED IMPLEMENTATION OF SIMULATED ANNEALING FOR THE TRAVELING SALESMAN PROBLEM [J].
ALLWRIGHT, JRA ;
CARPENTER, DB .
PARALLEL COMPUTING, 1989, 10 (03) :335-338
[2]   A distributed evolutionary simulated annealing algorithm for combinatorial optimisation problems [J].
Aydin, ME ;
Fogarty, TC .
JOURNAL OF HEURISTICS, 2004, 10 (03) :269-292
[3]   Parallel simulated annealing algorithms for cell placement on hypercube multiprocessors [J].
Banerjee, Prithviraj ;
Jones, Mark Howard ;
Sargent, Jeff S. .
IEEE Transactions on Parallel and Distributed Systems, 1990, 1 (01) :91-106
[4]   The parameterless self-organizing map algorithm [J].
Berglund, E ;
Sitte, J .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (02) :305-316
[5]   A methodological approach to parallel simulated annealing on an SMP system [J].
Bevilacqua, A .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2002, 62 (10) :1548-1570
[6]  
Beyer H.-G., 2001, NAT COMP SER
[7]   Parallel computing for chromosome reconstruction via ordering of DNA sequences [J].
Bhandarkar, SM ;
Machaka, S ;
Chirravuri, S ;
Arnold, J .
PARALLEL COMPUTING, 1998, 24 (08) :1177-1204
[8]  
BRAUN HC, 1990, PARALLEL PROBLEM SOL, P129
[9]   A PARALLEL SIMULATED ANNEALING ALGORITHM FOR THE PLACEMENT OF MACROCELLS [J].
CASOTTO, A ;
ROMEO, F ;
SANGIOVANNIVINCENTELLI, A .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 1987, 6 (05) :838-847
[10]   Parallel genetic simulated annealing: A massively parallel SIMD algorithm [J].
Chen, H ;
Flann, NS ;
Watson, DW .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 1998, 9 (02) :126-136