Event-Based Color Segmentation With a High Dynamic Range Sensor

被引:14
作者
Marcireau, Alexandre [1 ]
Ieng, Sio-Hoi [1 ]
Simon-Chane, Camille [1 ,2 ]
Benosman, Ryad B. [1 ]
机构
[1] UPMC Univ Paris 06, Sorbonne Univ, INSERM, CNRS,UMRI S 968,UMR S 968,UMR 7210,Inst Vis, Paris, France
[2] Univ Cergy Pontoise, Univ Paris Seine, ETIS UMR 8051, ENSEA,CNRS, Paris, France
关键词
event-based signal processing; AER; color segmentation; tracking; silicon retina; OBJECT SEGMENTATION; MEAN-SHIFT; EXTRACTION; ALGORITHM; TRACKING; VISION;
D O I
10.3389/fnins.2018.00135
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This paper introduces a color asynchronous neuromorphic event-based camera and a methodology to process color output from the device to perform color segmentation and tracking at the native temporal resolution of the sensor (down to one microsecond). Our color vision sensor prototype is a combination of three Asynchronous Time-based Image Sensors, sensitive to absolute color information. We devise a color processing algorithm leveraging this information. It is designed to be computationally cheap, thus showing how low level processing benefits from asynchronous acquisition and high temporal resolution data. The resulting color segmentation and tracking performance is assessed both with an indoor controlled scene and two outdoor uncontrolled scenes. The tracking's mean error to the ground truth for the objects of the outdoor scenes ranges from two to twenty pixels.
引用
收藏
页数:13
相关论文
共 50 条
[21]   Event-based imaging of levitated microparticles [J].
Ren, Yugang ;
Benedetto, Enrique ;
Borrill, Harry ;
Savchuk, Yelizaveta ;
Message, Molly ;
O'Flynn, Katie ;
Rashid, Muddassar ;
Millen, James .
APPLIED PHYSICS LETTERS, 2022, 121 (11)
[22]   Photorealistic image reconstruction from hybrid intensity and event-based sensor [J].
Shedligeri, Prasan A. ;
Mitra, Kaushik .
JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (06)
[23]   Image processing pipeline for segmentation and material classification based on multispectral high dynamic range polarimetric images [J].
Angel Martinez-Domingo, Miguel ;
Valero, Eva M. ;
Hernandez-Andres, Javier ;
Tominaga, Shoji ;
Horiuchi, Takahiko ;
Hirai, Keita .
OPTICS EXPRESS, 2017, 25 (24) :30073-30090
[24]   TrackAER: real-time event-based quantitative flow visualization [J].
Rusch, Alexander ;
Roesgen, Thomas .
EXPERIMENTS IN FLUIDS, 2023, 64 (08)
[25]   Dynamic Event-Based Nonsingular Practical Fixed-Time Second-Order Consensus [J].
Liu, Jian ;
Shi, Jinglong ;
Yuan, Xin ;
Wu, Yongbao ;
Sun, Changyin .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (02) :1959-1970
[26]   Adaptive Dynamic Event-Based Robust Control for Multiple Networked Euler-Lagrange Systems [J].
Wang, Hao ;
Shan, Jinjun .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025,
[27]   Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor [J].
Delbruck, Tobi ;
Lang, Manuel .
FRONTIERS IN NEUROSCIENCE, 2013, 7
[28]   Neutron-Induced, Single-Event Effects on Neuromorphic Event-Based Vision Sensor: A First Step and Tools to Space Applications [J].
Roffe, Seth ;
Akolkar, Himanshu ;
George, Alan D. ;
Linares-Barranco, Bernabe ;
Benosman, Ryad B. .
IEEE ACCESS, 2021, 9 :85748-85763
[29]   Auto-Tuned Event-Based Perception Scheme for Intrusion Monitoring With UAS [J].
Pablo Rodriguez-Gomez, Juan ;
Gomez Eguiluz, Augusto ;
Ramiro Martinez-De Dios, Jose ;
Ollero, Anibal .
IEEE ACCESS, 2021, 9 :44840-44854
[30]   Event-Based Robust Optimal Consensus Control for Nonlinear Multiagent System With Local Adaptive Dynamic Programming [J].
Wang, Jie ;
Zhang, Zitao ;
Tian, Bailing ;
Zong, Qun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) :1073-1086