MGRCFusion: An infrared and visible image fusion network based on multi-scale group residual convolution

被引:0
|
作者
Zhu, Pan [1 ]
Yin, Yufei [1 ]
Zhou, Xinglin [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Machinery & Automat, Wuhan 430081, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
Image fusion; Infrared and visible image; Multi-scale group residual convolution; Dense connection;
D O I
10.1016/j.optlastec.2024.111576
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The purpose of fusing infrared and visible images is to obtain an informative image that contains bright thermal targets and rich visible texture details. However, the existing deep learning-based algorithms generally neglect finer deep-level multi-scale features, and only the last layer of features is injected into the feature fusion strategy. To this end, we propose an optimized network model for deeper-level multi-scale features extraction based on multi-scale group residual convolution. Meanwhile, a dense connection module is designed to adequately integrate these multi-scale feature information. We contrast our method with advanced deep learning-based algorithms on multiple datasets. Extensive qualitative and quantitative experiments reveal that our method surpasses the existing fusion methods. Furthermore, ablation experiments illustrate the excellence of the multi-scale group residual convolution module for infrared and visible image fusion.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] Facial Expression Image Classification Based on Multi-scale Feature Fusion Residual Network
    Zhao, Yuxi
    Wang, Chunzhi
    Zhou, Xianjing
    Liu, Hu
    Communications in Computer and Information Science, 2023, 1811 CCIS : 105 - 118
  • [32] Steganalysis for HEVC video based on multi-scale residual convolution network
    Zhang M.
    Li Z.
    Liu J.
    Zhang Z.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (11): : 2226 - 2233
  • [33] Multi-scale Fusion Residual Network For Single Image Rain Removal
    He, Jia-Chen
    Fu, Ming-Jian
    Lin, Li-Qun
    Journal of Computers (Taiwan), 2023, 34 (02) : 129 - 140
  • [34] MULTI-SCALE CONVOLUTION-TRANSFORMER FUSION NETWORK FOR ENDOSCOPIC IMAGE SEGMENTATION
    Zou, Baosheng
    Zhou, Zongguang
    Han, Ying
    Li, Kang
    Wang, Guotai
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [35] A hyperspectral image reconstruction algorithm based on RGB image using multi-scale atrous residual convolution network
    Hu, Shaoxiang
    Hou, Rong
    Ming, Luo
    Su, Meifang
    Chen, Peng
    FRONTIERS IN MARINE SCIENCE, 2023, 9
  • [36] Infrared and visible images fusion based on improved multi-scale structural fusion
    Long Z.
    Deng Y.
    Xie J.
    Wang R.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2024, 32 (07): : 1101 - 1110
  • [37] Infrared and visible image fusion based on hybrid multi-scale decomposition and adaptive contrast enhancement
    Luo, Yueying
    He, Kangjian
    Xu, Dan
    Shi, Hongzhen
    Yin, Wenxia
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2025, 130
  • [38] Multi-scale infrared and visible image fusion framework based on dual partial differential equations
    Guo, Chentong
    Liu, Chenhua
    Deng, Lei
    Chen, Zhixiang
    Dong, Mingli
    Zhu, Lianqing
    Chen, Hanrui
    Lu, Xitian
    INFRARED PHYSICS & TECHNOLOGY, 2023, 135
  • [39] Infrared and visible image fusion based on saliency detection and deep multi-scale orientational features
    Liu, Gang
    Jia, Menghan
    Wang, Xiao
    Bavirisetti, Durga
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [40] Infrared and visible image fusion based on dilated residual attention network
    Mustafa, Hafiz Tayyab
    Yang, Jie
    Mustafa, Hamza
    Zareapoor, Masoumeh
    OPTIK, 2020, 224 (224):