Event-based object detection and recognition for Driver vision enhancement

被引:0
作者
AlRemeithi, Hamad [1 ]
Swamidoss, Issac Niwas [1 ]
Al Mansoori, Abdulla [1 ]
AlMarzooqi, Abdulrahman [1 ]
Sayadi, Slim [1 ]
Bouamer, Tarek [1 ]
机构
[1] Tawazun Technol & Innovat TTI, POB 127788, Abu Dhabi, U Arab Emirates
来源
SPIE FUTURE SENSING TECHNOLOGIES 2023 | 2023年 / 12327卷
关键词
Event camera; Neuromorphic sensing; Image fusion; Object detection; Driver vision enhancement; RGB camera; NEUROMORPHIC VISION;
D O I
10.1117/12.2653224
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Object detection is a critical task in computer vision, with applications ranging from robotics to surveillance. Traditional RGB-based methods often face challenges in low-light, high-speed, or high-dynamic-range scenarios, resulting in blurred or low-contrast images. In this paper, we present a novel algorithmic approach that fuses event data from event cameras with RGB images to improve object detection performance in real-time. Event cameras, unlike traditional frame-based cameras, provide high temporal resolution and dynamic range, capturing intensity changes asynchronously at the pixel level. Our method leverages the complementary strengths of event data and RGB images to reconstruct blurred images while retaining contrast information from the original data. We propose an algorithmic pipeline that first fuses event data and RGB images, followed by a reconstruction step to generate enhanced images suitable for object detection tasks. The pipeline does not rely on deep learning techniques, making it computationally efficient and well-suited for real-time applications. To validate the effectiveness of our approach, we compare its performance against the popular YOLO benchmarks for object detection tasks. Moreover, we assess real-time metrics to demonstrate the practicality of our method in time-sensitive applications.
引用
收藏
页数:10
相关论文
共 25 条
  • [1] Bubak M., 2004, Computational Science-ICCS 2004. 3039
  • [2] Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception
    Chen, Guang
    Cao, Hu
    Conradt, Jorg
    Tang, Huajin
    Rohrbein, Florian
    Knoll, Alois
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (04) : 34 - 49
  • [3] Multi-Cue Event Information Fusion for Pedestrian Detection With Neuromorphic Vision Sensors
    Chen, Guang
    Cao, Hu
    Ye, Canbo
    Zhang, Zhenyan
    Liu, Xingbo
    Mo, Xuhui
    Qu, Zhongnan
    Conradt, Jorg
    Roehrbein, Florian
    Knoll, Alois
    [J]. FRONTIERS IN NEUROROBOTICS, 2019, 13
  • [4] Pseudo-labels for Supervised Learning on Dynamic Vision Sensor Data, Applied to Object Detection under Ego-motion
    Chen, Nicholas F. Y.
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 757 - 766
  • [5] Etienne P., 2020, PROC 34 C NEURAL INF
  • [6] Feng S., 2017, P BMVC
  • [7] Event Density Based Denoising Method for Dynamic Vision Sensor
    Feng, Yang
    Lv, Hengyi
    Liu, Hailong
    Zhang, Yisa
    Xiao, Yuyao
    Han, Chengshan
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (06):
  • [8] Event-Based, 6-DOF Camera Tracking from Photometric Depth Maps
    Gallego, Guillermo
    Lund, Jon E. A.
    Mueggler, Elias
    Rebecq, Henri
    Delbruck, Tobi
    Scaramuzza, Davide
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (10) : 2402 - 2412
  • [9] Gehrig M, 2023, Arxiv, DOI [arXiv:2212.05598, 10.48550/ARXIV.2212.05598]
  • [10] Hamad A.R., 2023, SPIE Future Sensing Technologies, V12327