High-Dynamic-Range Tone Mapping in Intelligent Automotive Systems

被引:6
作者
Shopovska, Ivana [1 ]
Stojkovic, Ana [1 ]
Aelterman, Jan [1 ]
Van Hamme, David [1 ]
Philips, Wilfried [1 ]
机构
[1] Univ Ghent, IMEC, IPI, B-9000 Ghent, Belgium
关键词
high dynamic range; tone mapping; deep learning; object detection; autonomous driving; OBJECT DETECTION; OPERATOR; NETWORK;
D O I
10.3390/s23125767
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Intelligent driver assistance systems are becoming increasingly popular in modern passenger vehicles. A crucial component of intelligent vehicles is the ability to detect vulnerable road users (VRUs) for an early and safe response. However, standard imaging sensors perform poorly in conditions of strong illumination contrast, such as approaching a tunnel or at night, due to their dynamic range limitations. In this paper, we focus on the use of high-dynamic-range (HDR) imaging sensors in vehicle perception systems and the subsequent need for tone mapping of the acquired data into a standard 8-bit representation. To our knowledge, no previous studies have evaluated the impact of tone mapping on object detection performance. We investigate the potential for optimizing HDR tone mapping to achieve a natural image appearance while facilitating object detection of state-of-the-art detectors designed for standard dynamic range (SDR) images. Our proposed approach relies on a lightweight convolutional neural network (CNN) that tone maps HDR video frames into a standard 8-bit representation. We introduce a novel training approach called detection-informed tone mapping (DI-TM) and evaluate its performance with respect to its effectiveness and robustness in various scene conditions, as well as its performance relative to an existing state-of-the-art tone mapping method. The results show that the proposed DI-TM method achieves the best results in terms of detection performance metrics in challenging dynamic range conditions, while both methods perform well in typical, non-challenging conditions. In challenging conditions, our method improves the detection F2 score by 13%. Compared to SDR images, the increase in F2 score is 49%.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] HIGH-DYNAMIC-RANGE ULTRASOUND: APPLICATION FOR IMAGING TENDON PATHOLOGY
    Xiao, Yiming
    Boily, Mathieu
    Hashemi, Hoda Sadat
    Rivaz, Hassan
    ULTRASOUND IN MEDICINE AND BIOLOGY, 2018, 44 (07) : 1525 - 1532
  • [32] NOISE REDUCED HIGH DYNAMIC RANGE TONE MAPPING USING INFORMATION CONTENT WEIGHTS
    Zhu, Zijian
    Li, Zhengguo
    Wu, Shiqian
    Franti, Pasi
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 1255 - 1259
  • [33] Iterative Tone Mapping of High Dynamic Range Images Based on Structural Fidelity Measure
    Yaacoub, Charles
    Bilane, Petra
    Yaghi, Cendrella
    Bou-Rizk, Christine
    5TH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, THEORY, TOOLS AND APPLICATIONS 2015, 2015, : 535 - 539
  • [34] Unified implementation of global high dynamic range image tone- mapping algorithms
    Khan, Ishtiaq Rasool
    Rahardja, Susanto
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (05) : 4643 - 4656
  • [35] Tone Mapping Algorithm for High Dynamic Range Images Based on Improved Laplacian Pyramid
    Zhang Bowen
    Xia Zhenping
    Zhang Yueyuan
    Cheng Cheng
    Liu Yujie
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (04)
  • [36] High-dynamic range tone-mapping algorithm for focal plane processors
    Vargas-Sierra, S.
    Linan-Cembrano, G.
    Roca, E.
    Rodriguez-Vazquez, A.
    BIOELECTRONICS, BIOMEDICAL, AND BIOINSPIRED SYSTEMS V AND NANOTECHNOLOGY V, 2011, 8068
  • [37] Photographic High-Dynamic-Range Scalar Visualization
    Zhou, Liang
    Rivinius, Marc
    Johnson, Chris R.
    Weiskopf, Daniel
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (06) : 2156 - 2167
  • [38] High dynamic range image tone mapping technique based on the improved bitonic filter
    Kiran, B. Ravi
    Kumari, V. Valli
    INTERNATIONAL JOURNAL OF KNOWLEDGE-BASED AND INTELLIGENT ENGINEERING SYSTEMS, 2019, 23 (02) : 121 - 129
  • [39] Forward and backward tone mapping of High Dynamic Range images based on subband architecture
    Bouzidi, Ines
    Zaid, Azza Ouled
    IMAGE QUALITY AND SYSTEM PERFORMANCE XII, 2015, 9396
  • [40] High dynamic range image tone mapping and retexturing using fast trilateral filtering
    Shen, Jianbing
    Jin, Xiaogang
    Sun, Hanqiu
    VISUAL COMPUTER, 2007, 23 (9-11) : 641 - 650