Digital Implementation of Oscillatory Neural Network for Image Recognition Applications

被引:18
作者
Abernot, Madeleine [1 ]
Gil, Thierry [1 ]
Jimenez, Manuel [2 ]
Nunez, Juan [2 ]
Avellido, Maria J. [2 ]
Linares-Barranco, Bernabe [2 ]
Gonos, Theophile [3 ]
Hardelin, Tanguy [3 ]
Todri-Sanial, Aida [1 ]
机构
[1] Univ Montpellier, Lab Informat Robot & Microelect Montpellier, CNRS, Montpellier, France
[2] Univ Seville, Inst Microelect Sevilla, CSIC, IMSE CNM, Seville, Spain
[3] AI Mergence, Paris, France
基金
欧盟地平线“2020”;
关键词
artificial intelligence; auto-associative memory; FPGA implementations; learning rules; oscillatory neural networks; pattern recognition; HARDWARE; PROCESSOR;
D O I
10.3389/fnins.2021.713054
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Computing paradigm based on von Neuman architectures cannot keep up with the ever-increasing data growth (also called "data deluge gap"). This has resulted in investigating novel computing paradigms and design approaches at all levels from materials to system-level implementations and applications. An alternative computing approach based on artificial neural networks uses oscillators to compute or Oscillatory Neural Networks (ONNs). ONNs can perform computations efficiently and can be used to build a more extensive neuromorphic system. Here, we address a fundamental problem: can we efficiently perform artificial intelligence applications with ONNs? We present a digital ONN implementation to show a proof-of-concept of the ONN approach of "computing-in-phase" for pattern recognition applications. To the best of our knowledge, this is the first attempt to implement an FPGA-based fully-digital ONN. We report ONN accuracy, training, inference, memory capacity, operating frequency, hardware resources based on simulations and implementations of 5 x 3 and 10 x 6 ONNs. We present the digital ONN implementation on FPGA for pattern recognition applications such as performing digits recognition from a camera stream. We discuss practical challenges and future directions in implementing digital ONN.
引用
收藏
页数:16
相关论文
共 62 条
[1]   A Probabilistic Compute Fabric Based on Coupled Ring Oscillators for Solving Combinatorial Optimization Problems [J].
Ahmed, Ibrahim ;
Chiu, Po-Wei ;
Moy, William ;
Kim, Chris H. .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2021, 56 (09) :2870-2880
[2]   STATISTICAL-MECHANICS OF NEURAL NETWORKS NEAR SATURATION [J].
AMIT, DJ ;
GUTFREUND, H ;
SOMPOLINSKY, H .
ANNALS OF PHYSICS, 1987, 173 (01) :30-67
[3]   Beyond von Neumann [J].
不详 .
NATURE NANOTECHNOLOGY, 2020, 15 (07) :507-507
[4]  
[Anonymous], 2014, ADV ARTIF NEURAL SYS, DOI [DOI 10.1155/2014/602325, 10.1155/2014/602325]
[5]  
Corti E., 2019, 2018 IEEE INT C REB
[6]  
Csaba G., 2016, PROC 15 INT WORKSHOP, P1
[7]   Computational Study of Spin-Torque Oscillator Interactions for Non-Boolean Computing Applications [J].
Csaba, Gyoergy ;
Porod, Wolfgang .
IEEE TRANSACTIONS ON MAGNETICS, 2013, 49 (07) :4447-4451
[8]   Coupled oscillators for computing: A review and perspective [J].
Csaba, Gyorgy ;
Porod, Wolfgang .
APPLIED PHYSICS REVIEWS, 2020, 7 (01)
[9]   Loihi: A Neuromorphic Manycore Processor with On-Chip Learning [J].
Davies, Mike ;
Srinivasa, Narayan ;
Lin, Tsung-Han ;
Chinya, Gautham ;
Cao, Yongqiang ;
Choday, Sri Harsha ;
Dimou, Georgios ;
Joshi, Prasad ;
Imam, Nabil ;
Jain, Shweta ;
Liao, Yuyun ;
Lin, Chit-Kwan ;
Lines, Andrew ;
Liu, Ruokun ;
Mathaikutty, Deepak ;
Mccoy, Steve ;
Paul, Arnab ;
Tse, Jonathan ;
Venkataramanan, Guruguhanathan ;
Weng, Yi-Hsin ;
Wild, Andreas ;
Yang, Yoonseok ;
Wang, Hong .
IEEE MICRO, 2018, 38 (01) :82-99
[10]  
Digilent, 2018, ZYB Z7 REF GUID