System on Chip Testbed for Deep Neuromorphic Neural Networks

被引:1
|
作者
Rodriguez, Nicolas [1 ]
Villemur, Martin [1 ]
Klepatsch, Daniel [1 ]
Ivanovich, Diego Gigena [1 ]
Julian, Pedro [1 ]
机构
[1] Silicon Austria Labs, Altenberger Str 66c, Linz, Austria
来源
2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS | 2023年
关键词
VLSI; Neuromorphic Computing; Neural Network Accelerators; CMOS;
D O I
10.1109/ISCAS46773.2023.10182079
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes a first prototype of a testbed System on chip (SoC) to design and evaluate different Neuromorphic Deep Neural Networks (NN) cores. The 1.25mmx1.25mm SoC was fabricated in a 65nm CMOS technology and implements a system composed of an ARM based microprocessor, two memory banks of 32KB, a QSPI serial interface and two NN accelerators. The first one is a novel neuromorphic accelerator consisting of a 5x5 kernel Symmetrical Simplicial (SymSimp) core with a depthwise separable structure, which allows to efficiently implement multi-channel convolutional layers by breaking 3D kernels into 2D kernels. The second is a 3x3 conventional MAC engine to implement the fully connected layers. Experimental results show an energy efficiency of 0.49pJ/OP, which is competitive when compared to similar technology ICs, and extrapolated to the MobileNetworkV2 ImageNet represents a factor of 2 improvement with respect to NVIDIA Jetson Nano.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Simplifying Deep Neural Networks for Neuromorphic Architectures
    Chung, Jaeyong
    Shin, Taehwan
    2016 ACM/EDAC/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2016,
  • [2] Neuromorphic Architectures for Spiking Deep Neural Networks
    Indiveri, Giacomo
    Corradi, Federico
    Qiao, Ning
    2015 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2015,
  • [3] InSight: An FPGA-Based Neuromorphic Computing System for Deep Neural Networks
    Hong, Taeyang
    Kang, Yongshin
    Chung, Jaeyong
    JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2020, 10 (04) : 1 - 18
  • [4] Deep Versus Wide Convolutional Neural Networks for Object Recognition on Neuromorphic System
    Alom, Md Zahangir
    Josue, Theodore
    Rahman, Md Nayim
    Mitchell, Will
    Yakopcic, Chris
    Taha, Tarek M.
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [5] A Scalable System-on-Chip Acceleration for Deep Neural Networks
    Shehzad, Faisal
    Rashid, Muhammad
    Sinky, Mohammed H.
    Alotaibi, Saud S.
    Zia, Muhammad Yousuf Irfan
    IEEE ACCESS, 2021, 9 : 95412 - 95426
  • [6] Optimization of Deep Neural Network for Neuromorphic System
    Lee, Jae Eun
    Lee, Chul Jun
    Lee, Dae Seok
    Kim, Dong Wook
    Seo, Young Ho
    2019 34TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2019), 2019, : 430 - 431
  • [7] Training Deep Neural Networks in Situ with Neuromorphic Photonics
    Filipovich, Matthew J.
    Guo, Zhimu
    Marquez, Bicky A.
    Morison, Hugh D.
    Shastri, Bhavin J.
    2020 IEEE PHOTONICS CONFERENCE (IPC), 2020,
  • [8] Benchmarking Deep Spiking Neural Networks on Neuromorphic Hardware
    Ostrau, Christoph
    Homburg, Jonas
    Klarhorst, Christian
    Thies, Michael
    Rueckert, Ulrich
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 610 - 621
  • [9] Neuromorphic deep spiking neural networks for seizure detection
    Yang, Yikai
    Eshraghian, Jason K.
    Truong, Nhan Duy
    Nikpour, Armin
    Kavehei, Omid
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2023, 3 (01):
  • [10] Deep Neural Networks on Chip - A Survey
    Huo Yingge
    Ali, Imran
    Lee, Kang-Yoon
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2020), 2020, : 589 - 592