Stochastic memristive devices for low cost learning of spatiotemporal signals in spiking neural networks

被引:0
作者
Fida, Aabid Amin [1 ]
Mittal, Sparsh [1 ]
机构
[1] Electronics and Communication Engineering, Indian Institute of Technology, Uttrakhand, Roorkee
来源
Engineering Research Express | 2024年 / 6卷 / 04期
关键词
ECG; EEG; memristor; memristorliquid state machines; resistive random access memory; spiking neural network;
D O I
10.1088/2631-8695/ad9a3e
中图分类号
学科分类号
摘要
Resistive switching devices are an excellent candidate for dedicated neural network hardware. They offer extremely low-power in-memory computing substrates for edge computing tasks like health monitoring. But, the imprecise and random conductance changes in these devices make deploying neural networks on such hardware significantly challenging. In this regard, biological random networks, known as liquid state machines (LSM), can be helpful. Using them as inspiration we can utilize the imprecise nature of the switching process for a low-cost training approach to learning in spiking recurrent neural networks. We rely on the inherent non-determinism associated with the conductance states in memristive devices to initialize the random weight matrices within a memristive LSM. We also utilize the randomness of the resistive states to introduce heterogeneity in the neuron parameters. The significance of the proposed approach is evaluated using arrhythmia and seizure detection edge computing tasks. For classification tasks using two datasets, our approach reduces the number of computational operations in the backward pass by factors of up to 66 × for the MIT-BIH arrhythmia dataset and 74 × for the CHB-MIT epileptic seizure dataset. The heterogeneity improves the network performance. We also show that our approach is resilient to write noise in memristive devices. © 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.
引用
收藏
相关论文
共 50 条
  • [41] RESPARC: A Reconfigurable and Energy-Efficient Architecture with Memristive Crossbars for Deep Spiking Neural Networks
    Ankit, Aayush
    Sengupta, Abhronil
    Panda, Priyadarshini
    Roy, Kaushik
    PROCEEDINGS OF THE 2017 54TH ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2017,
  • [42] Memristive Neural Networks: A Neuromorphic Paradigm for Extreme Learning Machine
    Liang, Huanghuang
    Cheng, Hong
    Wei, Jiacheng
    Zhang, Lu
    Yang, Lu
    Zhao, Yang
    Guo, Hongliang
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2019, 3 (01): : 15 - 23
  • [43] Subthreshold neuromorphic devices for Spiking Neural Networks applied to embedded AI
    Loyez, Christophe
    Carpentier, Kevin
    Sourikopoulos, Ilias
    Danneville, Francois
    2021 19TH IEEE INTERNATIONAL NEW CIRCUITS AND SYSTEMS CONFERENCE (NEWCAS), 2021,
  • [44] A Curiosity-Based Learning Method for Spiking Neural Networks
    Shi, Mengting
    Zhang, Tielin
    Zeng, Yi
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2020, 14
  • [45] Supervised learning in spiking neural networks: A review of algorithms and evaluations
    Wang, Xiangwen
    Lin, Xianghong
    Dang, Xiaochao
    NEURAL NETWORKS, 2020, 125 : 258 - 280
  • [46] Locally connected spiking neural networks for unsupervised feature learning
    Saunders, Daniel J.
    Patel, Devdhar
    Hazan, Hananel
    Siegelmann, Hava T.
    Kozma, Robert
    NEURAL NETWORKS, 2019, 119 : 332 - 340
  • [47] Delay learning based on temporal coding in Spiking Neural Networks
    Sun, Pengfei
    Wu, Jibin
    Zhang, Malu
    Devos, Paul
    Botteldooren, Dick
    NEURAL NETWORKS, 2024, 180
  • [48] Biologically Plausible Learning of Text Representation with Spiking Neural Networks
    Bialas, Marcin
    Mironczuk, Marcin Michal
    Mandziuk, Jacek
    PARALLEL PROBLEM SOLVING FROM NATURE - PPSN XVI, PT I, 2020, 12269 : 433 - 447
  • [49] Enhanced read resolution in reconfigurable memristive synapses for Spiking Neural Networks (vol 14, 8897, 2024)
    Das, Hritom
    Schuman, Catherine
    Chakraborty, Nishith N.
    Rose, Garrett S.
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [50] Efficient and hardware-friendly methods to implement competitive learning for spiking neural networks
    Qu, Lianhua
    Zhao, Zhenyu
    Wang, Lei
    Wang, Yong
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (17) : 13479 - 13490