Energy-Performance Assessment of Oscillatory Neural Networks Based on VO2 Devices for Future Edge AI Computing

被引:14
作者
Delacour, Corentin [1 ]
Carapezzi, Stefania [1 ]
Abernot, Madeleine [1 ]
Todri-Sanial, Aida [1 ]
机构
[1] Univ Montpellier, CNRS, Microelect Dept, LIRMM, F-34095 Montpellier, France
关键词
Edge AI; Hopfield neural network (HNN); image edge detection; oscillatory neural network (ONN); vanadium dioxide (VO2); SYNCHRONIZATION; RECOGNITION; INFERENCE; DELAY;
D O I
10.1109/TNNLS.2023.3238473
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Oscillatory neural network (ONN) is an emerging neuromorphic architecture composed of oscillators that implement neurons and are coupled by synapses. ONNs exhibit rich dynamics and associative properties, which can be used to solve problems in the analog domain according to the paradigm let physics compute. For example, compact oscillators made of VO2 material are good candidates for building low-power ONN architectures dedicated to AI applications at the edge, like pattern recognition. However, little is known about the ONN scalability and its performance when implemented in hardware. Before deploying ONN, it is necessary to assess its computation time, energy consumption, performance, and accuracy for a given application. Here, we consider a VO2-oscillator as an ONN building block and perform circuit-level simulations to evaluate the ONN performances at the architecture level. Notably, we investigate how the ONN computation time, energy, and memory capacity scale with the number of oscillators. It appears that the ONN energy grows linearly when scaling up the network, making it suitable for large-scale integration at the edge. Furthermore, we investigate the design knobs for minimizing the ONN energy. Assisted by technology computer-aided design (TCAD) simulations, we report on scaling down the dimensions of VO2 devices in crossbar (CB) geometry to decrease the oscillator voltage and energy. We benchmark ONN versus stateof-the-art architectures and observe that the ONN paradigm is a competitive energy-efficient solution for scaled VO2 devices oscillating above 100 MHz. Finally, we present how ONN can efficiently detect edges in images captured on low-power edge devices and compare the results with Sobel and Canny edge detectors.
引用
收藏
页码:10045 / 10058
页数:14
相关论文
共 56 条
  • [1] Oscillatory Neural Network as Hetero-Associative Memory for Image Edge Detection
    Abernot, Madeleine
    Gil, Thierry
    Todri-Sanial, Aida
    [J]. PROCEEDINGS OF THE 2022 ANNUAL NEURO-INSPIRED COMPUTATIONAL ELEMENTS CONFERENCE (NICE 2022), 2022, : 13 - 21
  • [2] Digital Implementation of Oscillatory Neural Network for Image Recognition Applications
    Abernot, Madeleine
    Gil, Thierry
    Jimenez, Manuel
    Nunez, Juan
    Avellido, Maria J.
    Linares-Barranco, Bernabe
    Gonos, Theophile
    Hardelin, Tanguy
    Todri-Sanial, Aida
    [J]. FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [3] A Probabilistic Compute Fabric Based on Coupled Ring Oscillators for Solving Combinatorial Optimization Problems
    Ahmed, Ibrahim
    Chiu, Po-Wei
    Moy, William
    Kim, Chris H.
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2021, 56 (09) : 2870 - 2880
  • [4] [Anonymous], DATASET STANDARD 512
  • [6] Advanced Design Methods From Materials and Devices to Circuits for Brain-Inspired Oscillatory Neural Networks for Edge Computing
    Carapezzi, Stefania
    Boschetto, Gabriele
    Delacour, Corentin
    Corti, Elisabetta
    Plews, Andrew
    Nejim, Ahmed
    Karg, Siegfried
    Todri-Sanial, Aida
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2021, 11 (04) : 586 - 596
  • [7] Multi-Scale Modeling and Simulation Flow for Oscillatory Neural Networks for Edge Computing
    Carapezzi, Stefania
    Delacour, Corentin
    Boschetto, Gabriele
    Corti, Elisabetta
    Abernot, Madeleine
    Nejim, Ahmed
    Gil, Thierry
    Karg, Siegfried
    Todri-Sanial, Aida
    [J]. 2021 19TH IEEE INTERNATIONAL NEW CIRCUITS AND SYSTEMS CONFERENCE (NEWCAS), 2021,
  • [8] A 31-$\mu$ W, 148-fs Step, 9-bit Capacitor-DAC-Based Constant-Slope Digital-to-Time Converter in 28-nm CMOS
    Chen, Peng
    Zhang, Feifei
    Zong, Zhirui
    Hu, Suoping
    Siriburanon, Teerachot
    Staszewski, Robert Bogdan
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2019, 54 (11) : 3075 - 3085
  • [9] DianNao: A Small-Footprint High-Throughput Accelerator for Ubiquitous Machine-Learning
    Chen, Tianshi
    Du, Zidong
    Sun, Ninghui
    Wang, Jia
    Wu, Chengyong
    Chen, Yunji
    Temam, Olivier
    [J]. ACM SIGPLAN NOTICES, 2014, 49 (04) : 269 - 283
  • [10] Time-Delay Encoded Image Recognition in a Network of Resistively Coupled VO2 on Si Oscillators
    Corti, E.
    Khanna, A.
    Niang, K.
    Robertson, J.
    Moselund, K. E.
    Gotsmann, B.
    Datta, S.
    Karg, S.
    [J]. IEEE ELECTRON DEVICE LETTERS, 2020, 41 (04) : 629 - 632