A spiking recurrent neural network with phase change memory synapses for decision making

被引:2
作者
Pedretti, G. [1 ,2 ]
Milo, V [1 ,2 ]
Hashemkhani, S. [1 ,2 ]
Mannocci, P. [1 ,2 ]
Melnic, O. [1 ,2 ]
Chicca, E. [3 ,4 ]
Ielmini, D. [1 ,2 ]
机构
[1] Politecn Milan, Dipartimento Elettron Informaz & Bioingn, I-20133 Milan, Italy
[2] IU NET, I-20133 Milan, Italy
[3] Bielefeld Univ, Fac Technol, Bielefeld, Germany
[4] Bielefeld Univ, Cognit Interact Technol Ctr Excellence CITEC, Bielefeld, Germany
来源
2020 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS) | 2020年
基金
欧洲研究理事会;
关键词
phase change memory (PCM); Hebbian learning; spiking recurrent neural network (RNN); associative memory; decision making; constraint satisfaction problems (CSPs); NEURONS;
D O I
10.1109/iscas45731.2020.9180513
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Neuronal activity of recurrent neural networks (RNNs) experimentally observed in the hippocampus is widely believed to play a key role for mammalian ability to associate concepts and make decisions. For this reason, RNNs have rapidly gained strong interest as computational enabler of brain-inspired cognitive functions in hardware. From the technology viewpoint, nonvolatile memory devices such as phase change memory (PCM) and resistive switching memory (RRAM) have become a key asset to allow for high synaptic density and biorealistic cognitive functionality. In this work, we demonstrate for the first time associative learning and decision making in a hardware Hopfield RNN with 6 spiking neurons and PCM synapses via storage, recall and competition of attractor states. We also experimentally demonstrate the solution of a constraint satisfaction problem (CSP) namely a Sudoku with size 2x2 in hardware and 9x9 in simulation. These results support spiking RNNs with PCM devices for the implementation of decision making capabilities in hardware neuromorphic systems.
引用
收藏
页数:5
相关论文
共 24 条
[11]   Emerging neuromorphic devices [J].
Ielmini, Daniele ;
Ambrogio, Stefano .
NANOTECHNOLOGY, 2020, 31 (09)
[12]   Memory and Information Processing in Neuromorphic Systems [J].
Indiveri, Giacomo ;
Liu, Shih-Chii .
PROCEEDINGS OF THE IEEE, 2015, 103 (08) :1379-1397
[13]   OPTIMIZATION BY SIMULATED ANNEALING [J].
KIRKPATRICK, S ;
GELATT, CD ;
VECCHI, MP .
SCIENCE, 1983, 220 (4598) :671-680
[14]   Synaptic electronics: materials, devices and applications [J].
Kuzum, Duygu ;
Yu, Shimeng ;
Wong, H-S Philip .
NANOTECHNOLOGY, 2013, 24 (38)
[15]   Low-Energy Robust Neuromorphic Computation Using Synaptic Devices [J].
Kuzum, Duygu ;
Jeyasingh, Rakesh Gnana David ;
Yu, Shimeng ;
Wong, H. -S. Philip .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 2012, 59 (12) :3489-3494
[16]   A Neuromorphic Computational Primitive for Robust Context-Dependent Decision Making and Context-Dependent Stochastic Computation [J].
Liang, Dongchen ;
Indiveri, Giacomo .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2019, 66 (05) :843-847
[17]  
Milo V, 2017, INT EL DEVICES MEET
[18]   Brain-inspired recurrent neural network with plastic RRAM synapses [J].
Milo, Valerio ;
Chicca, Elisabetta ;
Ielmini, Daniele .
2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
[19]   ACTIVITY OF HIPPOCAMPAL-FORMATION NEURONS IN THE MONKEY RELATED TO A CONDITIONAL SPATIAL RESPONSE TASK [J].
MIYASHITA, Y ;
ROLLS, ET ;
CAHUSAC, PMB ;
NIKI, H ;
FEIGENBAUM, JD .
JOURNAL OF NEUROPHYSIOLOGY, 1989, 61 (03) :669-678
[20]   NEURONAL CORRELATE OF VISUAL ASSOCIATIVE LONG-TERM-MEMORY IN THE PRIMATE TEMPORAL CORTEX [J].
MIYASHITA, Y .
NATURE, 1988, 335 (6193) :817-820