Method for High Dynamic Range Imaging Based on Deep Guided and Self-learning br

被引:0
作者
Zhang, Junchao [1 ]
Yang, Feifan [1 ,2 ]
Shi, Wei [1 ]
Chen, Jianlai [1 ]
Zhao, Dangjun [1 ]
Yang, Degui [1 ]
机构
[1] Cent South Univ, Sch Aeronaut & Astronaut, Changsha 410083, Peoples R China
[2] Beihang Univ, Res Inst Frontier Sci, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-exposure image fusion; High-dynamic-range imaging; Intensity fidelity constrain; Self-learning; NETWORK; FUSION;
D O I
10.11999/JEIT211188
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multi-exposure image fusion aims to fuse a series of images with different exposures for the samescene, and it is the main-stream method for high dynamic range imaging. To obtain more realistic results, aMulti-Exposure image Fusion Network(MEF-Net) based on deep guided and self-learning is proposed. Thisnetwork is designed to fuse any number of images with different exposures in an end-to-end way, and generatethe best-fused results in an unsupervised way. In terms of the loss function, an intensity fidelity constraint termand the weighted Multi-Exposure image Fusion Structural SIMilarity(MEF-SSIM) are introduced to improvethe fusion quality. Moreover, a self-learning method is adopted to fine-tune and optimize the pre-learned model,considering the fusion problem of two images under extreme exposure to mitigate the halo phenomenongenerated by fusion. Based on abundant testing data, experimental results show that the proposed algorithmout performs other mainstream methods in terms of both quantitative measurement and visual fused quality
引用
收藏
页码:291 / 299
页数:9
相关论文
共 28 条
[1]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[2]   Guided Image Filtering [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (06) :1397-1409
[3]   Reconstructing a High Dynamic Range Image With a Deeply Unsupervised Fusion Model [J].
Hou, Xinglin ;
Zhang, Junchao ;
Zhou, Peipei .
IEEE PHOTONICS JOURNAL, 2021, 13 (02)
[4]   Guided filter-based fusion method for multiexposure images [J].
Hou, Xinglin ;
Luo, Haibo ;
Qi, Feng ;
Zhou, Peipei .
OPTICAL ENGINEERING, 2016, 55 (11)
[5]   Infrared and Visible Image Fusion Method Based on Convolutional Auto-Encoder and Residual Block [J].
Jiang Zetao ;
He Yuting .
ACTA OPTICA SINICA, 2019, 39 (10)
[6]  
Jing SUN, 2016, INFORM TECHNOLOGY, P41
[7]   Unsupervised Deep Image Fusion With Structure Tensor Representations [J].
Jung, Hyungjoo ;
Kim, Youngjung ;
Jang, Hyunsung ;
Ha, Namkoo ;
Sohn, Kwanghoon .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3845-3858
[8]  
Lee SH, 2018, IEEE IMAGE PROC, P1737, DOI 10.1109/ICIP.2018.8451153
[9]   Fast Multi-Scale Structural Patch Decomposition for Multi-Exposure Image Fusion [J].
Li, Hui ;
Ma, Kede ;
Yong, Hongwei ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :5805-5816
[10]   DenseFuse: A Fusion Approach to Infrared and Visible Images [J].
Li, Hui ;
Wu, Xiao-Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2614-2623