MGRCFusion: An infrared and visible image fusion network based on multi-scale group residual convolution

被引:4
作者
Zhu, Pan [1 ]
Yin, Yufei [1 ]
Zhou, Xinglin [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Machinery & Automat, Wuhan 430081, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared and visible image; Multi-scale group residual convolution; Dense connection;
D O I
10.1016/j.optlastec.2024.111576
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The purpose of fusing infrared and visible images is to obtain an informative image that contains bright thermal targets and rich visible texture details. However, the existing deep learning-based algorithms generally neglect finer deep-level multi-scale features, and only the last layer of features is injected into the feature fusion strategy. To this end, we propose an optimized network model for deeper-level multi-scale features extraction based on multi-scale group residual convolution. Meanwhile, a dense connection module is designed to adequately integrate these multi-scale feature information. We contrast our method with advanced deep learning-based algorithms on multiple datasets. Extensive qualitative and quantitative experiments reveal that our method surpasses the existing fusion methods. Furthermore, ablation experiments illustrate the excellence of the multi-scale group residual convolution module for infrared and visible image fusion.
引用
收藏
页数:16
相关论文
共 48 条
[1]   A new image quality metric for image fusion: The sum of the correlations of differences [J].
Aslantas, V. ;
Bendes, E. .
AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2015, 69 (12) :160-166
[2]   Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform [J].
Bavirisetti, Durga Prasad ;
Dhuli, Ravindra .
IEEE SENSORS JOURNAL, 2016, 16 (01) :203-209
[3]   Pedestrian detection with unsupervised multispectral feature learning using deep neural networks [J].
Cao, Yanpeng ;
Guan, Dayan ;
Huang, Weilin ;
Yang, Jiangxin ;
Cao, Yanlong ;
Qiao, Yu .
INFORMATION FUSION, 2019, 46 :206-217
[4]   The fusion of infrared and visible images via decomposition-based structure transfer and local saliency detection [J].
Chen, Xu ;
Liu, Lei ;
Kong, Xiangyu .
OPTICS AND LASER TECHNOLOGY, 2022, 149
[5]   Region-based multimodal image fusion using ICA bases [J].
Cvejic, Nedeljko ;
Bull, David ;
Canagarajah, Nishan .
IEEE SENSORS JOURNAL, 2007, 7 (5-6) :743-751
[6]   Image quality measures and their performance [J].
Eskicioglu, AM ;
Fisher, PS .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) :2959-2965
[7]  
Fan Xu, 2013, 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2013), P453, DOI 10.1109/IHMSC.2013.255
[8]   Infrared and visible images fusion based on RPCA and NSCT [J].
Fu, Zhizhong ;
Wang, Xue ;
Xu, Jin ;
Zhou, Ning ;
Zhao, Yufei .
INFRARED PHYSICS & TECHNOLOGY, 2016, 77 :114-123
[9]  
Haghighat M, 2014, I C APPL INF COMM TE, P424
[10]  
Jia XY, 2023, Arxiv, DOI [arXiv:2108.10831, 10.48550/arXiv.2108.10831, DOI 10.48550/ARXIV.2108.10831]