A Single Chip SPAD Based Vision Sensing System With Integrated Memristive Spiking Neuromorphic Processing

被引:4
作者
Shawkat, Mst Shamim Ara [1 ]
Adnan, Md Musabbir [2 ]
Febbo, Rocco D. [2 ]
Murray, John J. [2 ]
Rose, Garrett S. [2 ]
机构
[1] Florida Int Univ, Dept Elect & Comp Engn, Miami, FL 33174 USA
[2] Univ Tennessee Knoxville, Dept Elect Engn & Comp Sci, Knoxville, TN 37996 USA
关键词
Single-photon avalanche diodes; Neuromorphics; Vision sensors; System-on-chip; Photonics; Machine vision; Robot sensing systems; Single-photon avalanche diode; SPAD; SPAD imager; vision sensor; neuromorphic computing; memristor; spiking neural network; SNN; address event representation; AER; TDC;
D O I
10.1109/ACCESS.2023.3244793
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a new scalable 8 x 8 single photon avalanche diode (SPAD) based vision sensor with integrated spiking neuromorphic system on a single chip. The proposed vision sensing system adopts the benefits of SPAD's high quantum efficiency and energy efficiency of memristive spiking neuromorphic processing. The SPAD based vision sensor includes biologically inspired address event representation (AER) readout to generate asynchronous digital address events at the output reducing computation and making it suitable to process directly with integrated on-chip spiking neuromorphic system in a faster and more energy efficient way. A novel on-chip interface is designed to convert the output events of a SPAD-based event sensor into temporally coded spikes (TCS) that enable on-chip processing with integrated spiking neuromorphic system. We have tested the prototype vision sensing system for imaging characters by SPAD based vision sensor and recognizing them using the integrated memristive spiking neuromorphic system. To help with the evaluation, we have built a complete temporal pulses data set from simulating the SPAD vision sensor with AER readout in imaging characters and applied directly to integrated spiking neuromorphic system via designed novel on-chip interface. The achieved accuracy is 89.54% with a power consumption of 316 mu W for the memristive neuromorphic processor. The SPAD based vision sensor exhibits array-level dynamic range of 148 dB with a power consumption of 2.8 mW. The designed SPAD-based vision sensing system with an integrated spiking neuromorphic system on a single chip shows great promise for robotics, autonomous vehicles, health, and security applications.
引用
收藏
页码:19441 / 19457
页数:17
相关论文
共 50 条
  • [41] Integrated Inspecting and Grading System of the Egg Quality Based on Machine Vision
    Liang D.
    Li P.
    Liang D.
    Chen X.
    Wu X.
    Journal of Chinese Institute of Food Science and Technology, 2020, 20 (11) : 247 - 254
  • [42] A Novel Illumination-Robust Hand Gesture Recognition System With Event-Based Neuromorphic Vision Sensor
    Chen, Guang
    Xu, Zhongcong
    Li, Zhijun
    Tang, Huajin
    Qu, Sanqing
    Ren, Kejia
    Knoll, Alois
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) : 508 - 520
  • [43] One Transistor One Electrolyte-Gated Transistor Based Spiking Neural Network for Power-Efficient Neuromorphic Computing System
    Li, Yue
    Xuan, Zihao
    Lu, Jikai
    Wang, Zhongrui
    Zhang, Xumeng
    Wu, Zuheng
    Wang, Yongzhou
    Xu, Han
    Dou, Chunmeng
    Kang, Yi
    Liu, Qi
    Lv, Hangbing
    Shang, Dashan
    ADVANCED FUNCTIONAL MATERIALS, 2021, 31 (26)
  • [44] KNOWLEDGE-BASED SUPERVISION AND CONTROL OF BIOPROCESS WITH A MACHINE VISION-BASED SENSING SYSTEM
    REN, JL
    REID, JF
    LITCHFIELD, JB
    JOURNAL OF BIOTECHNOLOGY, 1994, 36 (01) : 25 - 34
  • [45] Optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system and compressed sensing
    Du, Yang
    Long, Guoqiang
    Jiang, Donghua
    Chai, Xiuli
    Han, Junhe
    CHINESE PHYSICS B, 2023, 32 (11)
  • [46] Image Processing with Genetic Algorithm in a Raisin Sorting System Based on Machine Vision
    Abbasgholipour, Mahdi
    Alasti, Behzad Mohammadi
    Abbasgholipour, Vahdi
    Derakhshan, Ali
    Abbasgholipour, Mohammad
    Rahmatfam, Sharmin
    Rahmatfam, Sheyda
    Habibifar, Rahim
    FOURTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2012), 2012, 8334
  • [47] Machine vision based in-process light-emitting diode chip mounting system
    Ho, Chao-Ching
    Chen, You-Min
    Li, Po-Chieh
    MEASUREMENT & CONTROL, 2018, 51 (7-8) : 293 - 303
  • [48] AI-powered modular and general-purpose droplet processing system based on single-sided continuous optoelectrowetting chip
    Liu, Enqing
    Wang, Cui
    Du, Lin
    Li, Siyuan
    Riaud, Antoine
    Zhou, Jia
    SENSORS AND ACTUATORS B-CHEMICAL, 2024, 420
  • [49] A vision system for canning with fish sensing using rule-based matching and segmentation
    Zhang, Yi
    You, Mengbo
    Miyoshi, Tasuku
    Akashi, Takuya
    IEEJ TRANSACTIONS ON ELECTRICAL AND ELECTRONIC ENGINEERING, 2020, 15 (06) : 956 - 964
  • [50] Measurement method of LCD surface deformation for smartphone based on optical vision sensing system
    Lu, Qinghua
    Fu, Qingyu
    Luo, Lufeng
    Yuan, Qilong
    Wang Hua
    Yuan Yunguang
    OPTIK, 2018, 172 : 1079 - 1088