Bi-sigmoid spike-timing dependent plasticity learning rule for magnetic tunnel junction-based SNN

被引:1
作者
Daddinounou, Salah [1 ]
Vatajelu, Elena-Ioana [1 ]
机构
[1] Univ Grenoble Alpes, TIMA, Grenoble INP, Grenoble, France
关键词
SNN; STDP; neuromorphic; MTJ; spintronics; unsupervised; online learning; NEURAL-NETWORK; 3RD-GENERATION; DEVICE; POWER;
D O I
10.3389/fnins.2024.1387339
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
In this study, we explore spintronic synapses composed of several Magnetic Tunnel Junctions (MTJs), leveraging their attractive characteristics such as endurance, nonvolatility, stochasticity, and energy efficiency for hardware implementation of unsupervised neuromorphic systems. Spiking Neural Networks (SNNs) running on dedicated hardware are suitable for edge computing and IoT devices where continuous online learning and energy efficiency are important characteristics. We focus in this work on synaptic plasticity by conducting comprehensive electrical simulations to optimize the MTJ-based synapse design and find the accurate neuronal pulses that are responsible for the Spike Timing Dependent Plasticity (STDP) behavior. Most proposals in the literature are based on hardware-independent algorithms that require the network to store the spiking history to be able to update the weights accordingly. In this work, we developed a new learning rule, the Bi-Sigmoid STDP (B2STDP), which originates from the physical properties of MTJs. This rule enables immediate synaptic plasticity based on neuronal activity, leveraging in-memory computing. Finally, the integration of this learning approach within an SNN framework leads to a 91.71% accuracy in unsupervised image classification, demonstrating the potential of MTJ-based synapses for effective online learning in hardware-implemented SNNs.
引用
收藏
页数:15
相关论文
共 48 条
[11]   Overview of the SpiNNaker System Architecture [J].
Furber, Steve B. ;
Lester, David R. ;
Plana, Luis A. ;
Garside, Jim D. ;
Painkras, Eustace ;
Temple, Steve ;
Brown, Andrew D. .
IEEE TRANSACTIONS ON COMPUTERS, 2013, 62 (12) :2454-2467
[12]   Voltage-dependent synaptic plasticity: Unsupervised probabilistic Hebbian plasticity rule based on neurons membrane potential [J].
Garg, Nikhil ;
Balafrej, Ismael ;
Stewart, Terrence C. ;
Portal, Jean-Michel ;
Bocquet, Marc ;
Querlioz, Damien ;
Drouin, Dominique ;
Rouat, Jean ;
Beilliard, Yann ;
Alibart, Fabien .
FRONTIERS IN NEUROSCIENCE, 2022, 16
[13]  
Ghosh-Dastidar S, 2009, ADV INTEL SOFT COMPU, V61, P167
[14]   BindsNET: A Machine Learning-Oriented Spiking Neural Networks Library in Python']Python [J].
Hazan, Hananel ;
Saunders, Daniel J. ;
Khan, Hassaan ;
Patel, Devdhar ;
Sanghavi, Darpan T. ;
Siegelmann, Hava T. ;
Kozma, Robert .
FRONTIERS IN NEUROINFORMATICS, 2018, 12
[15]  
Hunsberger E, 2015, Arxiv, DOI [arXiv:1510.08829, 10.48550/arXiv.1510.08829]
[16]  
Ikeda S, 2010, NAT MATER, V9, P721, DOI [10.1038/NMAT2804, 10.1038/nmat2804]
[17]   Stochastic SOT Device Based SNN Architecture for On-Chip Unsupervised STDP Learning [J].
Jang, Yunho ;
Kang, Gyuseong ;
Kim, Taehwan ;
Seo, Yeongkyo ;
Lee, Kyung-Jin ;
Park, Byong-Guk ;
Park, Jongsun .
IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (09) :2022-2035
[18]   Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update [J].
Kim, Taeyoon ;
Hu, Suman ;
Kim, Jaewook ;
Kwak, Joon Young ;
Park, Jongkil ;
Lee, Suyoun ;
Kim, Inho ;
Park, Jong-Keuk ;
Jeong, YeonJoo .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2021, 15
[19]  
LeCun Y., 1990, ADV NEURAL INFORM PR, V2, P396, DOI DOI 10.5555/2969830.2969879
[20]   Training Deep Spiking Neural Networks Using Backpropagation [J].
Lee, Jun Haeng ;
Delbruck, Tobi ;
Pfeiffer, Michael .
FRONTIERS IN NEUROSCIENCE, 2016, 10