Deep progressive feature aggregation network for multi-frame high dynamic range imaging

被引:2
|
作者
Xiao, Jun [1 ]
Ye, Qian [2 ]
Liu, Tianshan [3 ]
Zhang, Cong [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[2] Tohoku Univ, Grad Sch Informat Sci, Sendai, Japan
[3] Nanjing Univ Posts & Telecommun, Sch Telecommun & Informat Engn, Nanjing, Peoples R China
关键词
Image processing; Image restoration; Computational photography; IMAGES; RECONSTRUCTION;
D O I
10.1016/j.neucom.2024.127804
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High dynamic range (HDR) imaging is an important task in image processing that aims to generate wellexposed images in scenes with varying illumination. Although existing multi -exposure fusion methods have achieved impressive results, generating high -quality HDR images in dynamic scenes remains difficult. The primary challenges are ghosting artifacts caused by object motion between low dynamic range images and distorted content in underexposure and overexposed regions. In this paper, we propose a deep progressive feature aggregation network for improving HDR imaging quality in dynamic scenes. To address the issues of object motion, our method implicitly samples high -correspondence features and aggregates them in a coarse -tofine manner for alignment. In addition, our method adopts a densely connected network structure based on the discrete wavelet transform, which aims to decompose the input features into multiple frequency subbands and adaptively restore corrupted contents. Experiments show that our proposed method can achieve state-of-the-art performance under different scenes, compared to other promising HDR imaging methods. Specifically, the HDR images generated by our method contain cleaner and more detailed content, with fewer distortions, leading to better visual quality.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Dual-Attention-Guided Network for Ghost-Free High Dynamic Range Imaging
    Yan, Qingsen
    Gong, Dong
    Shi, Javen Qinfeng
    van den Hengel, Anton
    Shen, Chunhua
    Reid, Ian
    Zhang, Yanning
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (01) : 76 - 94
  • [42] UPHDR-GAN: Generative Adversarial Network for High Dynamic Range Imaging With Unpaired Data
    Li, Ru
    Wang, Chuan
    Wang, Jue
    Liu, Guanghui
    Zhang, Heng-Yu
    Zeng, Bing
    Liu, Shuaicheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7532 - 7546
  • [43] Acceleration of high dynamic range imaging pipeline based on multi-threading and SIMD technologies
    Mantiuk, Radoslaw
    Pajak, Dawid
    COMPUTATIONAL SCIENCE - ICCS 2008, PT 1, 2008, 5101 : 780 - 789
  • [44] High Dynamic Range Imaging of Dynamic Scenes with Saturation Compensation but without Explicit Motion Compensation
    Chung, Haesoo
    Cho, Nam Ik
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 61 - 71
  • [45] Learning to Generate Multi-Exposure Stacks With Cycle Consistency for High Dynamic Range Imaging
    Lee, Siyeong
    Jo, So Yeon
    An, Gwon Hwan
    Kang, Suk-Ju
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2561 - 2574
  • [46] DEEP UNROLLING SHRINKAGE NETWORK FOR DYNAMIC MR IMAGING
    Zhang, Yinghao
    Li, Xiaodi
    Li, Weihang
    Hu, Yue
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1145 - 1149
  • [47] Dual-Branch Multi-Level Feature Aggregation Network for Pansharpening
    Cheng, Gui
    Shao, Zhenfeng
    Wang, Jiaming
    Huang, Xiao
    Dang, Chaoya
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (11) : 2023 - 2026
  • [48] Multi-scale feature aggregation network for single-image dehazing
    Zhao, Donghui
    Mo, Bo
    Zhu, Xiang
    IET IMAGE PROCESSING, 2024, 18 (11) : 2943 - 2961
  • [49] Smart-phone based computational microscopy using multi-frame contact imaging on a fiber-optic array
    Navruz, Isa
    Coskun, Ahmet F.
    Wong, Justin
    Mohammad, Saqib
    Tseng, Derek
    Nagi, Richie
    Phillips, Stephen
    Ozcan, Aydogan
    LAB ON A CHIP, 2013, 13 (20) : 4015 - 4023
  • [50] Robust High Dynamic Range Imaging by Rank Minimization
    Oh, Tae-Hyun
    Lee, Joon-Young
    Tai, Yu-Wing
    Kweon, In So
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (06) : 1219 - 1232