Hopfield neural network: The hyperbolic tangent and the piecewise-linear activation functions

被引:68
作者
Mathias, Amanda C. [1 ]
Rech, Paulo C. [1 ]
机构
[1] Univ Estado Santa Catarina, Dept Fis, BR-89219710 Joinville, Brazil
关键词
Hopfield neural network; Parameter-space; Lyapunov exponents; PARAMETER-SPACE; CIRCUIT;
D O I
10.1016/j.neunet.2012.06.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper reports two-dimensional parameter-space plots for both, the hyperbolic tangent and the piecewise-linear neuron activation functions of a three-dimensional Hopfield neural network. The plots obtained using both neuron activation functions are compared, and we show that similar features are present on them. The occurrence of self-organized periodic structures embedded in chaotic regions is verified for the two cases. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:42 / 45
页数:4
相关论文
共 13 条
[1]   Self-similar structures in a 2D parameter-space of an inductorless Chua's circuit [J].
Albuquerque, Holokx A. ;
Rubinger, Rero M. ;
Rech, Paulo C. .
PHYSICS LETTERS A, 2008, 372 (27-28) :4793-4798
[2]   Spiral periodic structure inside chaotic region in parameter-space of a Chua circuit [J].
Albuquerque, Holokx A. ;
Rech, Paulo C. .
INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS, 2012, 40 (02) :189-194
[3]   Periodicity hub and nested spirals in the phase diagram of a simple resistive circuit [J].
Bonatto, Cristian ;
Gallas, Jason A. C. .
PHYSICAL REVIEW LETTERS, 2008, 101 (05)
[4]   Non-Shilnikov cascades of spikes and hubs in a semiconductor laser with optoelectronic feedback [J].
Freire, Joana G. ;
Gallas, Jason A. C. .
PHYSICAL REVIEW E, 2010, 82 (03)
[5]   THE STRUCTURE OF INFINITE PERIODIC AND CHAOTIC HUB CASCADES IN PHASE DIAGRAMS OF SIMPLE AUTONOMOUS FLOWS [J].
Gallas, Jason A. C. .
INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2010, 20 (02) :197-211
[6]   NEURONS WITH GRADED RESPONSE HAVE COLLECTIVE COMPUTATIONAL PROPERTIES LIKE THOSE OF 2-STATE NEURONS [J].
HOPFIELD, JJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1984, 81 (10) :3088-3092
[7]   CHAOS, BIFURCATION AND ROBUSTNESS OF A CLASS OF HOPFIELD NEURAL NETWORKS [J].
Huang, Wen-Zhi ;
Huang, Yan .
INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2011, 21 (03) :885-895
[8]  
Korner E., 2007, NEUROCOMPUTING RES D
[9]  
Rech P. C., 2010, INT J NONLINEAR SCI, V10, P179
[10]   Some two-dimensional parameter spaces of a Chua system with cubic nonlinearity [J].
Stegemann, Cristiane ;
Albuquerque, Holokx A. ;
Rech, Paulo C. .
CHAOS, 2010, 20 (02)