Infrared and visible image fusion via dual encoder based on dense connection

被引:1
作者
Lu, Quan [1 ]
Zhang, Hongbin [1 ]
Yin, Linfei [1 ]
机构
[1] Guangxi Univ, Guangxi Key Lab Power Syst Optimizat & Energy Tech, Nanning 530004, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Dense connection; Infrared image; Loss function; Deep learning; NETWORK;
D O I
10.1016/j.patcog.2025.111476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the problems of information loss and edge blurring due to the loss of gradient features that tend to occur during the fusion of infrared and visible images, this study proposes a dual encoder image fusion method (DEFusion) based on dense connectivity. The proposed method processes infrared and visible images by different means, therefore guaranteeing the best possible preservation of the features of the original image. A new progressive fusion strategy is constructed to ensure that the network is better able to capture the detailed information present in visible images while minimizing the gradient loss of the infrared image. Furthermore, a novel loss function that includes gradient loss and content loss, which ensures that the fusion results consider both the detailed information and gradient of the source image, is proposed in this study to facilitate the fusion process. The experimental results with the state-of-art methods on TNO and RoadScene datasets verify that the proposed method exhibits superior performance in most indices. The fused image exhibits excellent subjective contrast and clarity, providing a strong visual perception. The results of the comparison experiment demonstrate that this method exhibits favorable characteristics in terms of generalization and robustness.
引用
收藏
页数:15
相关论文
共 38 条
[1]   A new image quality metric for image fusion: The sum of the correlations of differences [J].
Aslantas, V. ;
Bendes, E. .
AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2015, 69 (12) :160-166
[2]  
Fu Y., 2021, arXiv
[3]  
Fu Y, 2022, Arxiv, DOI [arXiv:2107.13967, 10.48550/arXiv.2107.13967, DOI 10.48550/ARXIV.2107.13967]
[4]   Infrared and visible image fusion of generative adversarial network based on multi-channel encoding and decoding [J].
Ji, Jingyu ;
Zhao, Yuefei ;
Zhang, Yuhua ;
Wang, Changlong ;
Ma, Xiaolin ;
Huang, Fuyu ;
Yao, Jiangyi .
INFRARED PHYSICS & TECHNOLOGY, 2023, 134
[5]   SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion [J].
Jian, Lihua ;
Yang, Xiaomin ;
Liu, Zheng ;
Jeon, Gwanggil ;
Gao, Mingliang ;
Chisholm, David .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[6]   Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion [J].
Li, Huafeng ;
Cen, Yueliang ;
Liu, Yu ;
Chen, Xun ;
Yu, Zhengtao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :4070-4083
[7]   Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning [J].
Li, Huafeng ;
He, Xiaoge ;
Tao, Dapeng ;
Tang, Yuanyan ;
Wang, Ruxin .
PATTERN RECOGNITION, 2018, 79 :130-146
[8]   NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models [J].
Li, Hui ;
Wu, Xiao-Jun ;
Durrani, Tariq .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) :9645-9656
[9]   DenseFuse: A Fusion Approach to Infrared and Visible Images [J].
Li, Hui ;
Wu, Xiao-Jun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2614-2623
[10]   Object matching of visible-infrared image based on attention mechanism and feature fusion [J].
Li, Wuxin ;
Chen, Qian ;
Gu, Guohua ;
Sui, Xiubao .
PATTERN RECOGNITION, 2025, 158