Bi-sigmoid spike-timing dependent plasticity learning rule for magnetic tunnel junction-based SNN

被引:1
作者
Daddinounou, Salah [1 ]
Vatajelu, Elena-Ioana [1 ]
机构
[1] Univ Grenoble Alpes, TIMA, Grenoble INP, Grenoble, France
关键词
SNN; STDP; neuromorphic; MTJ; spintronics; unsupervised; online learning; NEURAL-NETWORK; 3RD-GENERATION; DEVICE; POWER;
D O I
10.3389/fnins.2024.1387339
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In this study, we explore spintronic synapses composed of several Magnetic Tunnel Junctions (MTJs), leveraging their attractive characteristics such as endurance, nonvolatility, stochasticity, and energy efficiency for hardware implementation of unsupervised neuromorphic systems. Spiking Neural Networks (SNNs) running on dedicated hardware are suitable for edge computing and IoT devices where continuous online learning and energy efficiency are important characteristics. We focus in this work on synaptic plasticity by conducting comprehensive electrical simulations to optimize the MTJ-based synapse design and find the accurate neuronal pulses that are responsible for the Spike Timing Dependent Plasticity (STDP) behavior. Most proposals in the literature are based on hardware-independent algorithms that require the network to store the spiking history to be able to update the weights accordingly. In this work, we developed a new learning rule, the Bi-Sigmoid STDP (B2STDP), which originates from the physical properties of MTJs. This rule enables immediate synaptic plasticity based on neuronal activity, leveraging in-memory computing. Finally, the integration of this learning approach within an SNN framework leads to a 91.71% accuracy in unsupervised image classification, demonstrating the potential of MTJ-based synapses for effective online learning in hardware-implemented SNNs.
引用
收藏
页数:15
相关论文
共 48 条
[1]   Memristive Logic Design of Multifunctional Spiking Neural Network with Unsupervised Learning [J].
Andreeva, N. V. ;
Ryndin, E. A. ;
Gerasimova, M. I. .
BIONANOSCIENCE, 2020, 10 (04) :824-833
[2]  
Baji T., 2017, Photomask Japan 2017: XXIV Symposium on Photomask and Next-Generation Lithography Mask Technology, P24
[3]   Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition [J].
Cao, Yongqiang ;
Chen, Yang ;
Khosla, Deepak .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) :54-66
[4]   Spike timing-dependent plasticity: A Hebbian learning rule [J].
Caporale, Natalia ;
Dan, Yang .
ANNUAL REVIEW OF NEUROSCIENCE, 2008, 31 :25-46
[5]   Mean Field Theory of Self-Organizing Memristive Connectomes [J].
Caravelli, Francesco ;
Milano, Gianluca ;
Ricciardi, Carlo ;
Kuncic, Zdenka .
ANNALEN DER PHYSIK, 2023, 535 (08)
[6]   Analog Memristive Synapse in Spiking Networks Implementing Unsupervised Learning [J].
Covi, Erika ;
Brivio, Stefano ;
Serb, Alexander ;
Prodromakis, Themis ;
Fanciulli, Marco ;
Spiga, Sabina .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[7]  
Daddinounou S, 2022, IEEE INT SYMP DESIGN, P106, DOI 10.1109/DDECS54261.2022.9770171
[8]   Loihi: A Neuromorphic Manycore Processor with On-Chip Learning [J].
Davies, Mike ;
Srinivasa, Narayan ;
Lin, Tsung-Han ;
Chinya, Gautham ;
Cao, Yongqiang ;
Choday, Sri Harsha ;
Dimou, Georgios ;
Joshi, Prasad ;
Imam, Nabil ;
Jain, Shweta ;
Liao, Yuyun ;
Lin, Chit-Kwan ;
Lines, Andrew ;
Liu, Ruokun ;
Mathaikutty, Deepak ;
Mccoy, Steve ;
Paul, Arnab ;
Tse, Jonathan ;
Venkataramanan, Guruguhanathan ;
Weng, Yi-Hsin ;
Wild, Andreas ;
Yang, Yoonseok ;
Wang, Hong .
IEEE MICRO, 2018, 38 (01) :82-99
[9]   Unsupervised learning of digit recognition using spike-timing-dependent plasticity [J].
Diehl, Peter U. ;
Cook, Matthew .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2015, 9
[10]  
Wang YE, 2019, Arxiv, DOI arXiv:1907.10701