Real time unsupervised learning of visual stimuli in neuromorphic VLSI systems

被引:20
作者
Giulioni, Massimiliano [1 ]
Corradi, Federico [1 ,2 ,3 ]
Dante, Vittorio [1 ]
del Giudice, Paolo [1 ,4 ]
机构
[1] Ist Super Sanita, Dept Technol & Hlth, I-00161 Rome, Italy
[2] Univ Zurich, Inst Neuroinformat, CH-8006 Zurich, Switzerland
[3] Swiss Fed Inst Technol, Zurich, Switzerland
[4] Natl Inst Nucl Phys, Rome, Italy
关键词
DRIVEN SYNAPTIC PLASTICITY; SPIKING NEURONS; NEURAL-NETWORK; REALISTIC NETWORKS; WORKING-MEMORY; SYNAPSES; CAPACITY; PATTERNS;
D O I
10.1038/srep14730
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Neuromorphic chips embody computational principles operating in the nervous system, into microelectronic devices. In this domain it is important to identify computational primitives that theory and experiments suggest as generic and reusable cognitive elements. One such element is provided by attractor dynamics in recurrent networks. Point attractors are equilibrium states of the dynamics (up to fluctuations), determined by the synaptic structure of the network; a 'basin' of attraction comprises all initial states leading to a given attractor upon relaxation, hence making attractor dynamics suitable to implement robust associative memory. The initial network state is dictated by the stimulus, and relaxation to the attractor state implements the retrieval of the corresponding memorized prototypical pattern. In a previous work we demonstrated that a neuromorphic recurrent network of spiking neurons and suitably chosen, fixed synapses supports attractor dynamics. Here we focus on learning: activating on-chip synaptic plasticity and using a theory-driven strategy for choosing network parameters, we show that autonomous learning, following repeated presentation of simple visual stimuli, shapes a synaptic connectivity supporting stimulus-selective attractors. Associative memory develops on chip as the result of the coupled stimulus-driven neural activity and ensuing synaptic dynamics, with no artificial separation between learning and retrieval phases.
引用
收藏
页数:10
相关论文
共 52 条
[1]  
Alspector J., 1989, Advances in neural information processing systems, P748
[2]  
Amit D.J., 1989, Modeling brain function: The world of attractor neural networks
[3]   LEARNING INTERNAL REPRESENTATIONS IN AN ATTRACTOR NEURAL-NETWORK WITH ANALOG NEURONS [J].
AMIT, DJ ;
BRUNEL, N .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1995, 6 (03) :359-388
[4]  
Arthur J., 2006, ADV NEURAL INFORM PR, P75
[5]   Spike-Timing-Dependent Plasticity With Weight Dependence Evoked From Physical Constraints [J].
Bamford, Simeon A. ;
Murray, Alan F. ;
Willshaw, David J. .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2012, 6 (04) :385-398
[6]   Synchrony detection and amplification by silicon neurons with STDP synapses [J].
Bofill-i-Petit, A ;
Murray, AF .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (05) :1296-1304
[7]   Learning real-world stimuli in a neural network with spike-driven synaptic dynamics [J].
Brader, Joseph M. ;
Senn, Walter ;
Fusi, Stefano .
NEURAL COMPUTATION, 2007, 19 (11) :2881-2912
[8]   Attractors and noise: Twin drivers of decisions and multistability [J].
Braun, Jochen ;
Mattia, Maurizio .
NEUROIMAGE, 2010, 52 (03) :740-751
[9]   A Learning-Enabled Neuron Array IC Based Upon Transistor Channel Models of Biological Phenomena [J].
Brink, Stephen ;
Nease, Stephen ;
Hasler, Paul ;
Ramakrishnan, Shubha ;
Wunderlich, Richard ;
Basu, Arindam ;
Degnan, Brian .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2013, 7 (01) :71-81
[10]  
Cauwenberghs G, 1998, ANALOG CIRCUITS SIG, P381