Structure-embedded ghosting artifact suppression network for high dynamic range image reconstruction

被引:15
作者
Tang, Lingfeng [1 ,2 ]
Huang, Huan [1 ,2 ]
Zhang, Yafei [1 ,2 ]
Qi, Guanqiu [3 ]
Yu, Zhengtao [1 ,2 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650500, Yunnan, Peoples R China
[2] Kunming Univ Sci & Technol, Key Lab Artificial Intelligence Yunnan Prov, Kunming 650500, Yunnan, Peoples R China
[3] State Univ New York Buffalo State, Buffalo, NY 14222 USA
基金
中国国家自然科学基金;
关键词
High-dynamic-range imaging; Ghosting artifact suppression; Multi-head attention; Structure-embedded network; REGISTRATION; RESOLUTION;
D O I
10.1016/j.knosys.2023.110278
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In high-dynamic-range (HDR) image reconstruction, the background offset among multiple multi-exposure low-dynamic-range (LDR) images, wide-range movement of targets, and missing edge structure information in the over-/under-exposure region cause both ghosting and blurring artifacts. This study proposed a structure-embedded ghosting artifact suppression network (SGARN) to achieve detailed preservation and ghosting artifact suppression to address this issue. According to the different image feature maps' correlation in channels, a channel and multi-head joint attention network (CMAN) was designed to highlight the features conducive to high-quality HDR image reconstruction. A dense multi-scale information transfer network (DMITN) was designed to integrate the characteristics of different combinations of convolution kernels with different receptive fields. In addition, a structure-embedded network was designed to predict the edge structure to be compensated from the reference image. The predicted edge was integrated into the reconstructed HDR image. Compared with state-of-the-art methods, the proposed method can achieve better visual performance and higher objective evaluation results on three public datasets. The source codes of the proposed method are available at https://github.com/lhf12278/SGARN.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 49 条
[1]   Single-Image HDR Reconstruction with Task-specific Network based on Channel Adaptive RDN [J].
Chen, Guannan ;
Zhang, Lijie ;
Sun, Mengdi ;
Gao, Yan ;
Michelini, Pablo Navarrete ;
Wu, YanHong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :398-403
[2]   HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantization [J].
Chen, Xiangyu ;
Liu, Yihao ;
Zhang, Zhengwen ;
Qiao, Yu ;
Dong, Chao .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :354-363
[3]   Offset Learning Based Channel Estimation for Intelligent Reflecting Surface-Assisted Indoor Communication [J].
Chen, Zhen ;
Tang, Jie ;
Zhang, Xiu Yin ;
Wu, Qingqing ;
Wang, Yuxin ;
So, Daniel K. C. ;
Jin, Shi ;
Wong, Kai-Kit .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (01) :41-55
[4]  
Chung H., 2022, PROC IEEE WINTER C A, P2951
[5]   HDR image reconstruction from a single exposure using deep CNNs [J].
Eilertsen, Gabriel ;
Kronander, Joel ;
Denes, Gyorgy ;
Mantiuk, Rafal K. ;
Unger, Jonas .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (06)
[6]  
Feng R, 2019, ISPRS Annals of the Photogrammetry Remote Sensing and Spatial Information Sciences, VIV-2/W5, P479, DOI 10.5194/isprs-annals-iv-2-w5-479-2019
[7]   Advances and Opportunities in Remote Sensing Image Geometric Registration: A Systematic Review of State-of-the-Art Approaches and Future Research Directions [J].
Feng, Ruitao ;
Shen, Huanfeng ;
Bai, Jianjun ;
Li, Xinghua .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2021, 9 (04) :120-142
[8]   Robust registration for remote sensing images by combining and localizing feature- and area-based methods [J].
Feng, Ruitao ;
Du, Qingyun ;
Li, Xinghua ;
Shen, Huanfeng .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 151 :15-26
[9]   Snapshot High Dynamic Range Imaging via Sparse Representations and Feature Learning [J].
Fotiadou, Konstantina ;
Tsagkatakis, Grigorios ;
Tsakalides, Panagiotis .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (03) :688-703
[10]  
Gallo O., 2009, 2009 IEEE International Conference on Computational Photography (ICCP), P1