MCADFusion: a novel multi-scale convolutional attention decomposition method for enhanced infrared and visible light image fusion

被引:0
作者
Zhang, Wangwei [1 ]
Dai, Menghao [1 ]
Zhou, Bin [2 ]
Wang, Changhai [1 ]
机构
[1] Zhengzhou Univ Light Ind, Software Engn Coll, 136 Sci Rd, Zhengzhou 450000, Peoples R China
[2] Zhengzhou Univ Sci & Technol, Elect & Elect Engn Coll, 1 Xueyuan Rd, Zhengzhou 450064, Peoples R China
来源
ELECTRONIC RESEARCH ARCHIVE | 2024年 / 32卷 / 08期
关键词
image fusion; multi-scale; convolutional attention decomposition; modal specificity; shared features; ENSEMBLE; NETWORK; NEST;
D O I
10.3934/era.2024233
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
This paper presents a method called MCADFusion, a feature decomposition technique specifically designed for the fusion of infrared and visible images, incorporating target radiance and detailed texture. MCADFusion employs an innovative two-branch architecture that effectively ff ectively extracts and decomposes both local and global features from different ff erent source images, thereby enhancing the processing of image feature information. The method begins with a multi-scale feature extraction module and a reconstructor module to obtain local and global feature information from rich source images. Subsequently, the local and global features of different ff erent source images are decomposed using the the channel attention module (CAM) and the spatial attention module (SAM). Feature fusion is then performed through a two-channel attention merging method. Finally, image reconstruction is achieved using the restormer module. During the training phase, MCADFusion employs a two-stage strategy to optimize the network parameters, resulting in high-quality fused images. Experimental results demonstrate that MCADFusion surpasses existing techniques in both subjective visual evaluation and objective assessment on publicly available TNO and MSRS datasets, underscoring its superiority.
引用
收藏
页码:5067 / 5089
页数:23
相关论文
共 50 条
  • [1] MFT: Multi-scale Fusion Transformer for Infrared and Visible Image Fusion
    Zhang, Chen-Ming
    Yuan, Chengbo
    Luo, Yong
    Zhou, Xin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 485 - 496
  • [2] Prompt learning and multi-scale attention for infrared and visible image fusion
    Li, Yanan
    Ji, Qingtao
    Jiao, Shaokang
    INFRARED PHYSICS & TECHNOLOGY, 2025, 145
  • [4] MEEAFusion: Multi-Scale Edge Enhancement and Joint Attention Mechanism Based Infrared and Visible Image Fusion
    Xie, Yingjiang
    Fei, Zhennan
    Deng, Da
    Meng, Lingshuai
    Niu, Fu
    Sun, Jinggong
    SENSORS, 2024, 24 (17)
  • [5] Deep Neural Network for Infrared and Visible Image Fusion Based on Multi-scale Decomposition and Interactive Residual Coordinate Attention
    Zong, Sha
    Xie, Zhihua
    Li, Qiang
    Liu, Guodong
    ADVANCES IN NATURAL COMPUTATION, FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY, ICNC-FSKD 2022, 2023, 153 : 254 - 262
  • [6] GLMAFuse: A Dual-Stream Infrared and Visible Image Fusion Framework Integrating Local and Global Features with Multi-Scale Attention
    Li, Fu
    Gu, Yanghai
    Zhao, Ming
    Chen, Deji
    Wang, Quan
    ELECTRONICS, 2024, 13 (24):
  • [7] A Multi-Scale Infrared and Visible Image Fusion Network Based on Context Perception
    Zhao, Huixuan
    Cheng, Jinyong
    Du, Rundong
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 395 - 400
  • [8] An Infrared and Visible Image Fusion Framework based on Dual Scale Decomposition and Learnable Attention Fusion Strategy
    Cheng, Guanzheng
    Jin, Lizuo
    Chai, Lin
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4087 - 4092
  • [9] Infrared and visible image fusion based on multi-scale dense attention connection network
    Chen Y.
    Zhang J.
    Wang Z.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (18): : 2253 - 2266
  • [10] Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion
    Xu, Qian
    Zheng, Yuan
    IEEE ACCESS, 2024, 12 : 8359 - 8372