High dynamic range imaging via gradient-aware context aggregation network

被引:24
作者
Yan, Qingsen [1 ]
Gong, Dong [1 ]
Shi, Javen Qinfeng [1 ]
Hengel, Anton van den [1 ]
Sun, Jinqiu [2 ]
Zhu, Yu [2 ]
Zhang, Yanning [2 ]
机构
[1] Univ Adelaide, Adelaide, SA 5005, Australia
[2] Northwestern Polytech Univ, Xian, Peoples R China
关键词
High dynamic range imaging; Deep learning; Exposure fusion; Ghosting artifacts; Image gradients; IMAGES;
D O I
10.1016/j.patcog.2021.108342
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Obtaining a high dynamic range (HDR) image from multiple low dynamic range images with different ex-posures is an important step in various computer vision tasks. One of the ongoing challenges in the field is to generate HDR images without ghosting artifacts. Motivated by an observation that such artifacts are particularly noticeable in the gradient domain, in this paper, we propose an HDR imaging approach that aggregates the information from multiple LDR images with guidance from image gradient domain. The proposed method generates artifact-free images by integrating the image gradient information and the image context information in the pixel domain. The context information in a large area helps to re-construct the contents contaminated by saturation and misalignments. Specifically, an additional gradient stream and the supervision in the gradient domain are applied to incorporate the gradient information in HDR imaging. To use the context information captured from a large area while preserving spatial resolu-tion, we adopt dilated convolutions to extract multi-scale features with rich context information. More -over, we build a new dataset containing 40 groups of real-world images from diverse scenes with ground truth to validate the proposed model. The samples in the proposed dataset include more challenging moving objects inducing misalignments. Extensive experimental results demonstrate that our proposed model outperforms previous methods on different datasets in terms of both quantitative measure and visual perception quality. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 48 条
  • [1] Bogoni L, 2000, INT C PATT RECOG, P7, DOI 10.1109/ICPR.2000.903475
  • [2] Blind quality index for tone-mapped images based on luminance partition
    Chen, Pengfei
    Li, Leida
    Zhang, Xinfeng
    Wang, Shanshe
    Tan, Allen
    [J]. PATTERN RECOGNITION, 2019, 89 : 108 - 118
  • [3] Fast Image Processing with Fully-Convolutional Networks
    Chen, Qifeng
    Xu, Jia
    Koltun, Vladlen
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2516 - 2525
  • [4] Debevec P. E., 1997, Computer Graphics Proceedings, SIGGRAPH 97, P369, DOI 10.1145/258734.258884
  • [5] HDR image reconstruction from a single exposure using deep CNNs
    Eilertsen, Gabriel
    Kronander, Joel
    Denes, Gyorgy
    Mantiuk, Rafal K.
    Unger, Jonas
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06):
  • [6] Deep Reverse Tone Mapping
    Endo, Yuki
    Kanamori, Yoshihiro
    Mitani, Jun
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06):
  • [7] Funt B, 2010, COLOR IMAG CONF, P256
  • [8] Simultaneous HDR and Optic Flow Computation
    Hafner, David
    Demetz, Oliver
    Weickert, Joachim
    [J]. 2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 2065 - 2070
  • [9] Heo YS, 2011, LECT NOTES COMPUT SC, V6495, P486, DOI 10.1007/978-3-642-19282-1_39
  • [10] HDR Deghosting: How to deal with Saturation?
    Hu, Jun
    Gallo, Orazio
    Pulli, Kari
    Sun, Xiaobai
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1163 - 1170