A Multi-scale Threshold Spiking Mechanism Based on Spike Camera

被引:0
作者
Ma, Xueshan [1 ,2 ]
Xiao, Yongsheng [2 ,3 ]
Ma, Lei [2 ]
机构
[1] Karamay Vocat & Tech Coll, Karamay, Peoples R China
[2] Peking Univ, Beijing, Peoples R China
[3] Nanchang Hangkong Univ, Nanchang, Jiangxi, Peoples R China
来源
THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021) | 2022年 / 12083卷
关键词
Spike camera; neuromorphic sensor; multi-scale threshold; video encoding; dynamic range;
D O I
10.1117/12.2623468
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Inspired by biological vision, neuromorphic sensors attempt to mimic the sensing and visual processing in the retina. Its working principle is quite different from the conventional camera. Among these revolutionary sensors, the spike camera can report an accumulation of per-pixel brightness intensity by emitting high-speed spikes. The spike camera has enormous potential for computer vision and robotics in all kinds of scenarios. However, the fixed threshold used in the sampling method of the spike camera limits the dynamic range of the scene. Inspired by the HDR of conventional cameras, this paper designs a multi-scale threshold spiking mechanism based on the spike camera and the corresponding reconstruction algorithm, which increases the dynamic range. Experimental results show that it can significantly improve the quality of reconstructed frames.
引用
收藏
页数:8
相关论文
共 17 条
  • [1] A 240 x 180 130 dB 3 μs Latency Global Shutter Spatiotemporal Vision Sensor
    Brandli, Christian
    Berner, Raphael
    Yang, Minhao
    Liu, Shih-Chii
    Delbruck, Tobi
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2014, 49 (10) : 2333 - 2341
  • [2] Brandli C, 2014, IEEE INT SYMP CIRC S, P686, DOI 10.1109/ISCAS.2014.6865228
  • [3] A review of the integrate-and-fire neuron model: I. Homogeneous synaptic input
    Burkitt, A. N.
    [J]. BIOLOGICAL CYBERNETICS, 2006, 95 (01) : 1 - 19
  • [4] Delbruck T, 2014, IEEE INT SYMP CIRC S, P2636, DOI 10.1109/ISCAS.2014.6865714
  • [5] Spike Camera and Its Coding Methods
    Dong, Siwei
    Huang, Tiejun
    Tian, Yonghong
    [J]. 2017 DATA COMPRESSION CONFERENCE (DCC), 2017, : 437 - 437
  • [6] Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579
  • [7] Multiple Exposure Fusion for High Dynamic Range Image Acquisition
    Jinno, Takao
    Okuda, Masahiro
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (01) : 358 - 365
  • [8] High dynamic range imaging by fusing multiple raw images and tone reproduction
    Kao, Wen-Chung
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2008, 54 (01) : 10 - 15
  • [9] Lichtsteiner P., 2006, 2006 INT SOLID STATE, P508
  • [10] A 128x128 120 dB 15 μs latency asynchronous temporal contrast vision sensor
    Lichtsteiner, Patrick
    Posch, Christoph
    Delbruck, Tobi
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2008, 43 (02) : 566 - 576