Digital Implementation of On-Chip Hebbian Learning for Oscillatory Neural Network

被引:0
|
作者
Luhulima, Edgar [1 ]
Abernot, Madeleine [2 ]
Corradi, Federico [1 ]
Todri-Sanial, Aida [1 ,2 ]
机构
[1] Eindhoven Univ Technol, Eindhoven, Netherlands
[2] Univ Montpellier, CNRS, LIRMM, Montpellier, France
来源
2023 IEEE/ACM INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN, ISLPED | 2023年
关键词
Artificial intelligence; auto-associative memory; pattern recognition; oscillatory neural network; FPGA implementation; Hebbian learning;
D O I
10.1109/ISLPED58423.2023.10244501
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work proposes a digital implementation of an Oscillatory Neural Network (ONN) in a Field-Programmable Gate Array (FPGA), demonstrating excellent associative memory capabilities. This work goes beyond previous implementations by enabling on-chip learning directly in the FPGA. More specifically, we implement on-chip Hebbian learning, and we compare three different design strategies. The first strategy takes advantage of a System-on-Chip (SoC) composed of a Processing System (PS) and Programmable Logic resources (PL) to integrate Hebbian learning in PS. The two other strategies implement the Hebbian learning directly in PL. We compare the three different design strategies on a digit recognition task in terms of accuracy, utilization, execution time, and maximum frequency. We show that implementing Hebbian learning in PL gives more advantages in terms of resource utilization and latency than implementing Hebbian in PS with several orders of magnitude because the weight matrix computation is performed in hardware. Moreover, we develop an application interface to demonstrate the pattern learning and recognition capabilities of our digital ONN implementation.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] An On-Chip BP Learning Neural Network with Ideal Neuron Characteristics and Learning Rate Adaptation
    Chun Lu
    Bing-Xue Shi
    Lu Chen
    Analog Integrated Circuits and Signal Processing, 2002, 31 : 55 - 62
  • [42] An on-chip BP learning neural network with ideal neuron characteristics and learning rate adaptation
    Lu, C
    Shi, BX
    Chen, L
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 2002, 31 (01) : 55 - 62
  • [43] Learning Rule for a Quantum Neural Network Inspired by Hebbian Learning
    Osakabe, Yoshihiro
    Sato, Shigeo
    Akima, Hisanao
    Kinjo, Mitsunaga
    Sakuraba, Masao
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (02) : 237 - 245
  • [44] Enabling Non-Hebbian Learning in Recurrent Spiking Neural Processors With Hardware-Friendly On-Chip Intrinsic Plasticity
    Liu, Yu
    Zhang, Wenrui
    Li, Peng
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (03) : 465 - 474
  • [45] A general assembly as implementation of a Hebbian rule in a Boolean neural network
    Lauria, FE
    Milo, M
    Prevete, R
    Visco, S
    NEURAL NETS - WIRN VIETRI-99, 1999, : 266 - 271
  • [46] ANALOG IMPLEMENTATION OF A KOHONEN MAP WITH ON-CHIP LEARNING
    MACQ, D
    VERLEYSEN, M
    JESPERS, P
    LEGAT, JD
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 1993, 4 (03): : 456 - 461
  • [47] Artificial neural network on-chip and in-pixel implementation towards pulse amplitude measurement
    Koziol, A.
    Szczygiel, R.
    Kuznar, D.
    Strzalka, K.
    Wielgosz, M.
    Otfinowski, P.
    Maj, P.
    JOURNAL OF INSTRUMENTATION, 2023, 18 (02):
  • [48] ANTI-HEBBIAN LEARNING IN A NONLINEAR NEURAL NETWORK
    CARLSON, A
    BIOLOGICAL CYBERNETICS, 1990, 64 (02) : 171 - 176
  • [49] Pulse-width-modulation feedforward neural network design with on-chip learning
    Bor, JC
    Wu, CY
    APCCAS '96 - IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS '96, 1996, : 369 - 372
  • [50] On-chip Learning In A Conventional Silicon MOSFET Based Analog Hardware Neural Network
    Dey, Nilabjo
    Sharda, Janak
    Saxena, Utkarsh
    Kaushik, Divya
    Singh, Utkarsh
    Bhowmik, Debanjan
    2019 IEEE BIOMEDICAL CIRCUITS AND SYSTEMS CONFERENCE (BIOCAS 2019), 2019,