Circuit Optimization Techniques for Efficient Ex-Situ Training of Robust Memristor Based Liquid State Machine

被引:2
|
作者
Henderson, Alex [1 ]
Yakopcic, Chris [2 ]
Merkel, Cory [3 ]
Harbour, Steven [1 ]
Taha, Tarek M. [2 ]
Hazan, Hananel [4 ]
机构
[1] Southwest Res Inst, Dayton Engn Adv Projects Lab, Beavercreek, OH 45431 USA
[2] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
[3] Rochester Inst Technol, Dept Comp Engn, Rochester, NY 14623 USA
[4] Tufts Univ, Allen Discovery Ctr, Medford, MA 02155 USA
来源
PROCEEDINGS OF THE 17TH ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES, NANOARCH 2022 | 2022年
关键词
Spiking Neural Network; Memristor; Liquid State Machine;
D O I
10.1145/3565478.3572542
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Spiking neural network hardware offers a high performance, power-efficient and robust platform for the processing of complex data. Many of these systems require supervised learning, which poses a challenge when using gradient-based algorithms due to the discontinuous properties of SNNs. Memristor based hardware can offer gains in portability, power reduction, and throughput efficiency when compared to pure CMOS. This paper proposes a memristor-based spiking liquid state machine (LSM). The inherent dynamics of the LSM permit the use of supervised learning without backpropagation for weight updates. To carry out the design space evaluation of the LSM for optimal hardware performance, several temporal signal classification tasks are performed. It is found that the binary neuron activations in the output layer improve testing accuracy by 3.7% and 5% for classification, while reducing training time. A power and energy analysis of the proposed hardware is presented, resulting in an approximately 50% reduction in power consumption and cycle energy.
引用
收藏
页数:6
相关论文
共 8 条
  • [1] Memristor Based Liquid State Machine With Method for In-Situ Training
    Henderson, Alex
    Yakopcic, Chris
    Merkel, Cory
    Hazan, Hananel
    Harbour, Steven
    Taha, Tarek M.
    IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2024, 23 : 376 - 385
  • [2] Ex-Situ Programming in a Neuromorphic Memristor Based Crossbar Circuit
    Yakopcic, Chris
    Taha, Tarek M.
    PROCEEDINGS OF THE 2015 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2015, : 300 - 304
  • [3] Memristor Based Circuit Design for Liquid State Machine Verified with Temporal Classification
    Henderson, Alex
    Yakopcic, Chris
    Harbour, Steven
    Taha, Tarek M.
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [4] Learning Method for Ex-situ Training of Memristor Crossbar based Multi-Layer Neural Network
    Bala, Anu
    Adeyemo, Adedotun
    Yang, Xiaohan
    Jabir, Abusaleh
    2017 9TH INTERNATIONAL CONGRESS ON ULTRA MODERN TELECOMMUNICATIONS AND CONTROL SYSTEMS AND WORKSHOPS (ICUMT), 2017, : 305 - 310
  • [5] Robustness of a Memristor Based Liquid State Machine
    Soures, Nicholas
    Hays, Lydia
    Kudithipudi, Dhireesha
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 2414 - 2420
  • [6] Efficient Techniques for Training the Memristor-based Spiking Neural Networks Targeting Better Speed, Energy and Lifetime
    Ma, Yu
    Zhou, Pingqiang
    2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 390 - 395
  • [7] PHAX: Physical Characteristics Aware Ex-Situ Training Framework for Inverter-Based Memristive Neuromorphic Circuits
    Ansari, Mohammad
    Fayyazi, Arash
    Banagozar, Ali
    Maleki, Mohammad Ali
    Kamal, Mehdi
    Afzali-Kusha, Ali
    Pedram, Massoud
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2018, 37 (08) : 1602 - 1613
  • [8] Design and Architectural Co-optimization of Monolithic 3D Liquid State Machine-based Neuromorphic Processor
    Ku, Bon Woong
    Liu, Yu
    Jin, Yingyezhe
    Samal, Sandeep
    Li, Peng
    Lim, Sung Kyu
    2018 55TH ACM/ESDA/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2018,