Digital Implementation of On-Chip Hebbian Learning for Oscillatory Neural Network

被引:0
|
作者
Luhulima, Edgar [1 ]
Abernot, Madeleine [2 ]
Corradi, Federico [1 ]
Todri-Sanial, Aida [1 ,2 ]
机构
[1] Eindhoven Univ Technol, Eindhoven, Netherlands
[2] Univ Montpellier, CNRS, LIRMM, Montpellier, France
来源
2023 IEEE/ACM INTERNATIONAL SYMPOSIUM ON LOW POWER ELECTRONICS AND DESIGN, ISLPED | 2023年
关键词
Artificial intelligence; auto-associative memory; pattern recognition; oscillatory neural network; FPGA implementation; Hebbian learning;
D O I
10.1109/ISLPED58423.2023.10244501
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work proposes a digital implementation of an Oscillatory Neural Network (ONN) in a Field-Programmable Gate Array (FPGA), demonstrating excellent associative memory capabilities. This work goes beyond previous implementations by enabling on-chip learning directly in the FPGA. More specifically, we implement on-chip Hebbian learning, and we compare three different design strategies. The first strategy takes advantage of a System-on-Chip (SoC) composed of a Processing System (PS) and Programmable Logic resources (PL) to integrate Hebbian learning in PS. The two other strategies implement the Hebbian learning directly in PL. We compare the three different design strategies on a digit recognition task in terms of accuracy, utilization, execution time, and maximum frequency. We show that implementing Hebbian learning in PL gives more advantages in terms of resource utilization and latency than implementing Hebbian in PS with several orders of magnitude because the weight matrix computation is performed in hardware. Moreover, we develop an application interface to demonstrate the pattern learning and recognition capabilities of our digital ONN implementation.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] A general-purpose neural network with on-chip BP learning
    Lu, C
    Shi, BX
    Chen, L
    2002 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL II, PROCEEDINGS, 2002, : 520 - 523
  • [22] A mixed-signal VLSI neural network with on-chip learning
    Mirhassani, M
    Ahmadi, M
    Miller, WC
    CCECE 2003: CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, VOLS 1-3, PROCEEDINGS: TOWARD A CARING AND HUMANE TECHNOLOGY, 2003, : 591 - 594
  • [23] Analog feed-forward neural network with on-chip learning
    Univ of Oslo, Oslo, Norway
    Analog Integr Circuits Signal Process, 1 (65-75):
  • [24] Frequency-based multilayer neural network with on-chip learning
    Hikawa, H
    ISCAS 96: 1996 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS - CIRCUITS AND SYSTEMS CONNECTING THE WORLD, VOL 3, 1996, : 469 - 472
  • [25] An analog feed-forward neural network with on-chip learning
    Berg, Y
    Sigvartsen, RL
    Lande, TS
    Abusland, A
    ANALOG INTEGRATED CIRCUITS AND SIGNAL PROCESSING, 1996, 9 (01) : 65 - 75
  • [26] A compact correlation filter for on-chip learning in a spiking neural network
    Allen, Jacob N.
    Abdel-Aty-Zohdy, Hoda S.
    Ewing, Robert L.
    IEEE MWSCAS'06: PROCEEDINGS OF THE 2006 49TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS,, 2006, : 733 - +
  • [27] CompactNet: High Accuracy Deep Neural Network Optimized for On-Chip Implementation
    Goel, Abhinav
    Liu, Zeye
    Blanton, Ronald D.
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 4723 - 4729
  • [28] A pulsed neural network with on-chip learning and its practical applications
    Zhuang, Hualiang
    Low, Kay-Soon
    Yau, Wei-Yun
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2007, 54 (01) : 34 - 42
  • [29] Hardware implementation of an expandable on-chip learning neural network with 8-neuron and 64-synapse
    Lu, C
    Shi, BX
    Chen, L
    2002 IEEE REGION 10 CONFERENCE ON COMPUTERS, COMMUNICATIONS, CONTROL AND POWER ENGINEERING, VOLS I-III, PROCEEDINGS, 2002, : 1451 - 1454
  • [30] Analog VLSI Implementation of Artificial Neural Networks with Supervised On-Chip Learning
    Maurizio Valle
    Analog Integrated Circuits and Signal Processing, 2002, 33 : 263 - 287