Generalizing event-based HDR imaging to various exposures

被引:1
作者
Li, Xiaopeng [1 ]
Lu, Qingyang [2 ]
Fan, Cien [1 ]
Zhao, Chen [1 ]
Zou, Lian [1 ]
Yu, Lei [1 ]
机构
[1] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
[2] Univ Calgary, Dept Comp Sci, Calgary, AB T2N 1N4, Canada
基金
中国国家自然科学基金;
关键词
High dynamic range imaging; Event-based vision; Multi-modal fusion; Various exposures; NETWORK; RECONSTRUCTION; FUSION; TRACKING;
D O I
10.1016/j.neucom.2024.128132
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single-exposure High Dynamic Range Imaging (HDRI), as a typical ill-posed problem, has attracted extensive attention from researchers. However, restoration in real-world scenarios has always been an intractable task due to various exposures and noise artifacts. This work proposes an event-based HDRI framework that generalizes to scenes under various exposures by exploiting the high dynamic range of events. To address the challenge of processing diverse exposures, we propose an exposure-aware network incorporating the exposure attention fusion module, which facilitates the adaptive fusion of SDR image and event features. Moreover, the problem of noise in extremely under-exposed regions and events is effectively alleviated by introducing a self-supervised loss, namely EDDN, which effectively enhances the details of saturated areas while simultaneously decreasing noise. We conduct novel event-based HDRI datasets to evaluate our proposed method for benchmarking with diverse exposed images. Comprehensive experiments have demonstrated that our method outperforms the state-of-the-art.
引用
收藏
页数:12
相关论文
共 79 条
  • [1] Event Probability Mask (EPM) and Event Denoising Convolutional Neural Network (EDnCNN) for Neuromorphic Cameras
    Baldwin, R. Wes
    Almatrafi, Mohammed
    Asari, Vijayan
    Hirakawa, Keigo
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1698 - 1707
  • [2] Banterle Francesco, 2017, Advanced High Dynamic Range Imaging
  • [3] Banterle Francesco, 2006, P 4 INT C COMP GRAPH, V11, P349
  • [4] Cadena P.R.G., 2023, P IEEECVF C COMPUTER, P4149
  • [5] L-CoIns: Language-based Colorization with Instance Awareness
    Chang, Zheng
    Weng, Shuchen
    Zhang, Peixuan
    Li, Yu
    Li, Si
    Shi, Boxin
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19221 - 19230
  • [6] HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset
    Chen, Guanying
    Chen, Chaofeng
    Guo, Shi
    Liang, Zhetong
    Wong, Kwan-Yee K.
    Zhang, Lei
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2482 - 2491
  • [7] HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantization
    Chen, Xiangyu
    Liu, Yihao
    Zhang, Zhengwen
    Qiao, Yu
    Dong, Chao
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 354 - 363
  • [8] Learning Stereo High Dynamic Range Imaging From A Pair of Cameras With Different Exposure Parameters
    Chen, Yeyao
    Jiang, Gangyi
    Yu, Mei
    Yang, You
    Ho, Yo-Sung
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 : 1044 - 1058
  • [9] Debevec P. E., 1997, Computer Graphics Proceedings, SIGGRAPH 97, P369, DOI 10.1145/258734.258884
  • [10] FlowNet: Learning Optical Flow with Convolutional Networks
    Dosovitskiy, Alexey
    Fischer, Philipp
    Ilg, Eddy
    Haeusser, Philip
    Hazirbas, Caner
    Golkov, Vladimir
    van der Smagt, Patrick
    Cremers, Daniel
    Brox, Thomas
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2758 - 2766