MGRCFusion: An infrared and visible image fusion network based on multi-scale group residual convolution

被引:4
作者
Zhu, Pan [1 ]
Yin, Yufei [1 ]
Zhou, Xinglin [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Machinery & Automat, Wuhan 430081, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared and visible image; Multi-scale group residual convolution; Dense connection;
D O I
10.1016/j.optlastec.2024.111576
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The purpose of fusing infrared and visible images is to obtain an informative image that contains bright thermal targets and rich visible texture details. However, the existing deep learning-based algorithms generally neglect finer deep-level multi-scale features, and only the last layer of features is injected into the feature fusion strategy. To this end, we propose an optimized network model for deeper-level multi-scale features extraction based on multi-scale group residual convolution. Meanwhile, a dense connection module is designed to adequately integrate these multi-scale feature information. We contrast our method with advanced deep learning-based algorithms on multiple datasets. Extensive qualitative and quantitative experiments reveal that our method surpasses the existing fusion methods. Furthermore, ablation experiments illustrate the excellence of the multi-scale group residual convolution module for infrared and visible image fusion.
引用
收藏
页数:16
相关论文
共 48 条
[41]   SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion [J].
Zhang, Hao ;
Ma, Jiayi .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2021, 129 (10) :2761-2785
[42]  
Zhang H, 2020, AAAI CONF ARTIF INTE, V34, P12797
[43]   Dictionary learning method for joint sparse representation-based image fusion [J].
Zhang, Qiheng ;
Fu, Yuli ;
Li, Haifeng ;
Zou, Jian .
OPTICAL ENGINEERING, 2013, 52 (05)
[44]   IFCNN: A general image fusion framework based on convolutional neural network [J].
Zhang, Yu ;
Liu, Yu ;
Sun, Peng ;
Yan, Han ;
Zhao, Xiaolin ;
Zhang, Li .
INFORMATION FUSION, 2020, 54 :99-118
[45]   Principal Component Analysis-Based Image Fusion Routine with Application to Automotive Stamping Split Detection [J].
Zhou, Yi ;
Mayyas, Ahmad ;
Omar, Mohammed A. .
RESEARCH IN NONDESTRUCTIVE EVALUATION, 2011, 22 (02) :76-91
[46]   Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters [J].
Zhou, Zhiqiang ;
Wang, Bo ;
Li, Sun ;
Dong, Mingjie .
INFORMATION FUSION, 2016, 30 :15-26
[47]   Fusion of infrared-visible images using improved multi-scale top-hat transform and suitable fusion rules [J].
Zhu, Pan ;
Ma, Xiaoqing ;
Huang, Zhanhua .
INFRARED PHYSICS & TECHNOLOGY, 2017, 81 :282-295
[48]   Fusion of infrared and visible images based on BEMD and NSDFB [J].
Zhu, Pan ;
Huang, Zhanhua ;
Lei, Hai .
INFRARED PHYSICS & TECHNOLOGY, 2016, 77 :82-93