Deep progressive feature aggregation network for multi-frame high dynamic range imaging

被引:2
|
作者
Xiao, Jun [1 ]
Ye, Qian [2 ]
Liu, Tianshan [3 ]
Zhang, Cong [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[2] Tohoku Univ, Grad Sch Informat Sci, Sendai, Japan
[3] Nanjing Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Nanjing, Peoples R China
关键词
Image processing; Image restoration; Computational photography; IMAGES; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.127804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High dynamic range (HDR) imaging is an important task in image processing that aims to generate wellexposed images in scenes with varying illumination. Although existing multi -exposure fusion methods have achieved impressive results, generating high -quality HDR images in dynamic scenes remains difficult. The primary challenges are ghosting artifacts caused by object motion between low dynamic range images and distorted content in underexposure and overexposed regions. In this paper, we propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. To address the issues of object motion, our method implicitly samples high -correspondence features and aggregates them in a coarse -tofine manner for alignment. In addition, our method adopts a densely connected network structure based on the discrete wavelet transform, which aims to decompose the input features into multiple frequency subbands and adaptively restore corrupted contents. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes, compared to other promising HDR imaging methods. Specifically, the HDR images generated by our method contain cleaner and more detailed content, with fewer distortions, leading to better visual quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multi-Frame Content-Aware Mapping Network for Standard-Dynamic-Range to High-Dynamic-Range Television Artifact Removal
    Wang, Zheng
    He, Gang
    SENSORS, 2024, 24 (01)
  • [2] Progressive and Selective Fusion Network for High Dynamic Range Imaging
    Ye, Qian
    Xiao, Jun
    Lam, Kin-man
    Okatani, Takayuki
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5290 - 5297
  • [3] A Lightweight Network for High Dynamic Range Imaging
    Yan, Qingsen
    Zhang, Song
    Chen, Weiye
    Liu, Yuhang
    Zhang, Zhen
    Zhang, Yanning
    Shi, Javen Qinfeng
    Gong, Dong
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 823 - 831
  • [4] Pyramidal Feature Adjustment Networks for High Dynamic Range Imaging of Dynamic Scenes
    Chung, Haesoo
    Cho, Nam Ik
    IEEE ACCESS, 2023, 11 : 66882 - 66894
  • [5] High-Fidelity Imaging Using Compact Multi-Frame Blind Deconvolution
    Hope, Douglas A.
    Jefferies, Stuart M.
    Smith, Cody
    JOURNAL OF THE ASTRONAUTICAL SCIENCES, 2019, 66 (02): : 162 - 169
  • [6] High-Fidelity Imaging Using Compact Multi-Frame Blind Deconvolution
    Douglas A. Hope
    Stuart M. Jefferies
    Cody Smith
    The Journal of the Astronautical Sciences, 2019, 66 : 162 - 169
  • [7] High dynamic range imaging via gradient-aware context aggregation network
    Yan, Qingsen
    Gong, Dong
    Shi, Javen Qinfeng
    Hengel, Anton van den
    Sun, Jinqiu
    Zhu, Yu
    Zhang, Yanning
    PATTERN RECOGNITION, 2022, 122
  • [8] Multi-scale Dense Networks for Deep High Dynamic Range Imaging
    Yan, Qingsen
    Gong, Dong
    Zhang, Pingping
    Shi, Qinfeng
    Sun, Jinqiu
    Reid, Ian
    Zhang, Yanning
    2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 41 - 50
  • [9] Deep High Dynamic Range Imaging with Large Foreground Motions
    Wu, Shangzhe
    Xu, Jiarui
    Tai, Yu-Wing
    Tang, Chi-Keung
    COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 : 120 - 135
  • [10] Channel and spatial attention-guided network for deep high dynamic range imaging with large motions
    Zhang, Pingwei
    Zhou, Wenbiao
    Fan, Luyao
    VISUAL COMPUTER, 2024, 40 (03): : 1583 - 1599