Continuous attractors of discrete-time recurrent neural networks

被引:1
作者
Yu, Jiali [1 ]
Tang, Huajin [1 ]
Li, Haizhou [1 ,2 ]
机构
[1] Agcy Sci Technol & Res, Inst Infocomm Res, Singapore 138632, Singapore
[2] Univ New S Wales, Sch Elect Engn & Telecommun, Sydney, NSW 2052, Australia
关键词
Continuous attractors; Discrete-time; Linear-threshold recurrent neural networks; Connected; ASSOCIATIVE MEMORIES; THRESHOLD NEURONS; PATH-INTEGRATION; STABILITY; OPTIMIZATION; DYNAMICS; CONSTRAINTS; SYSTEMS; DESIGN; MODEL;
D O I
10.1007/s00521-012-0975-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper studies the continuous attractors of discrete-time recurrent neural networks. Networks in discrete time can directly provide algorithms for efficient implementation in digital hardware. Continuous attractors of neural networks have been used to store and manipulate continuous stimuli for animals. A continuous attractor is defined as a connected set of stable equilibrium points. It forms a lower dimensional manifold in the original state space. Under some conditions, the complete analytical expressions for the continuous attractors of discrete-time linear recurrent neural networks as well as discrete-time linear-threshold recurrent neural networks are derived. Examples are employed to illustrate the theory.
引用
收藏
页码:89 / 96
页数:8
相关论文
共 34 条
[1]   DISCRETE-TIME CELLULAR NEURAL NETWORKS FOR ASSOCIATIVE MEMORIES WITH LEARNING AND FORGETTING CAPABILITIES [J].
BRUCOLI, M ;
CARNIMEO, L ;
GRASSI, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1995, 42 (07) :396-399
[2]   A new approach to design cellular neural networks for associative memories [J].
Grassi, G .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1997, 44 (09) :835-838
[3]   NEURAL NETWORKS AND PHYSICAL SYSTEMS WITH EMERGENT COLLECTIVE COMPUTATIONAL ABILITIES [J].
HOPFIELD, JJ .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA-BIOLOGICAL SCIENCES, 1982, 79 (08) :2554-2558
[4]   Model for a robust neural integrator [J].
Koulakov, AA ;
Raghavachari, S ;
Kepecs, A ;
Lisman, JE .
NATURE NEUROSCIENCE, 2002, 5 (08) :775-782
[5]  
Liang XB, 2002, IEEE T CIRCUITS-I, V49, P695
[6]   ASYMPTOTIC STABILITY OF DISCRETE-TIME-SYSTEMS WITH SATURATION NONLINEARITIES WITH APPLICATIONS TO DIGITAL-FILTERS [J].
LIU, DR ;
MICHEL, AN .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-FUNDAMENTAL THEORY AND APPLICATIONS, 1992, 39 (10) :798-807
[7]   Design of continuous attractor networks with monotonic tuning using a symmetry principle [J].
Machens, Christian K. ;
Brody, Carlos D. .
NEURAL COMPUTATION, 2008, 20 (02) :452-485
[8]   Weighted centroid neural network for edge preserving image compression [J].
Park, DC ;
Woo, YJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2001, 12 (05) :1134-1146
[9]   Convergence analysis of a discrete-time recurrent neural network to perform quadratic real optimization with bound constraints [J].
Perez-Ilzarbe, MJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (06) :1344-1351
[10]   Information processing with population codes [J].
Pouget, A ;
Dayan, P ;
Zemel, R .
NATURE REVIEWS NEUROSCIENCE, 2000, 1 (02) :125-132