High-Dynamic-Range Tone Mapping in Intelligent Automotive Systems

被引:6
|
作者
Shopovska, Ivana [1 ]
Stojkovic, Ana [1 ]
Aelterman, Jan [1 ]
Van Hamme, David [1 ]
Philips, Wilfried [1 ]
机构
[1] Univ Ghent, IMEC, IPI, B-9000 Ghent, Belgium
关键词
high dynamic range; tone mapping; deep learning; object detection; autonomous driving; OBJECT DETECTION; OPERATOR; NETWORK;
D O I
10.3390/s23125767
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Intelligent driver assistance systems are becoming increasingly popular in modern passenger vehicles. A crucial component of intelligent vehicles is the ability to detect vulnerable road users (VRUs) for an early and safe response. However, standard imaging sensors perform poorly in conditions of strong illumination contrast, such as approaching a tunnel or at night, due to their dynamic range limitations. In this paper, we focus on the use of high-dynamic-range (HDR) imaging sensors in vehicle perception systems and the subsequent need for tone mapping of the acquired data into a standard 8-bit representation. To our knowledge, no previous studies have evaluated the impact of tone mapping on object detection performance. We investigate the potential for optimizing HDR tone mapping to achieve a natural image appearance while facilitating object detection of state-of-the-art detectors designed for standard dynamic range (SDR) images. Our proposed approach relies on a lightweight convolutional neural network (CNN) that tone maps HDR video frames into a standard 8-bit representation. We introduce a novel training approach called detection-informed tone mapping (DI-TM) and evaluate its performance with respect to its effectiveness and robustness in various scene conditions, as well as its performance relative to an existing state-of-the-art tone mapping method. The results show that the proposed DI-TM method achieves the best results in terms of detection performance metrics in challenging dynamic range conditions, while both methods perform well in typical, non-challenging conditions. In challenging conditions, our method improves the detection F2 score by 13%. Compared to SDR images, the increase in F2 score is 49%.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Tone mapping with contrast preservation and lightness correction in high dynamic range imaging
    Kim, Baek-Kyu
    Park, Rae-Hong
    Chang, SoonKeun
    SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (08) : 1425 - 1432
  • [22] Tone mapping with contrast preservation and lightness correction in high dynamic range imaging
    Baek-Kyu Kim
    Rae-Hong Park
    SoonKeun Chang
    Signal, Image and Video Processing, 2016, 10 : 1425 - 1432
  • [23] Analysis of Tone mapping Operators on High Dynamic Range Images
    Lakshmi, S. Venkata
    Sujatha
    Janet, J.
    Bellarmine, Thomas
    2012 PROCEEDINGS OF IEEE SOUTHEASTCON, 2012,
  • [24] Deep Tone Mapping Operator for High Dynamic Range Images
    Rana, Aakanksha
    Singh, Praveer
    Valenzise, Giuseppe
    Dufaux, Frederic
    Komodakis, Nikos
    Smolic, Aljosa
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 1285 - 1298
  • [25] High dynamic range imaging and local adaptive tone mapping
    Ikebe, Masayuki
    INTERNATIONAL SYMPOSIUM ON PHOTOELECTRONIC DETECTION AND IMAGING 2013: IMAGING SENSORS AND APPLICATIONS, 2013, 8908
  • [26] Fast global tone mapping for high dynamic range compression
    Wang, Ruoxi
    Li, Dengshi
    Multimedia Tools and Applications, 2024, 83 (42) : 90193 - 90206
  • [27] Hierarchical tone mapping for high dynamic range image visualization
    Qiu, GP
    Duan, J
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2005, PTS 1-4, 2005, 5960 : 2058 - 2066
  • [28] Gradient domain tone mapping of high dynamic range videos
    Lee, Chul
    Kim, Chang-Su
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 1589 - 1592
  • [29] Revertible tone mapping of high dynamic range imagery: Integration to JPEG 2000
    Bouzidi, I.
    Zaid, A. Ouled
    Larabi, M. C.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (05) : 5215 - 5239
  • [30] High-Dynamic-Range Texture Compression for Rendering Systems of Different Capacities
    Sun, Wen
    Lu, Yan
    Wu, Feng
    Li, Shipeng
    Tardif, John
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2010, 16 (01) : 57 - 69