Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion

被引:1
|
作者
Xu, Qian [1 ]
Zheng, Yuan [2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
[2] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618311, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; parallel attention mechanism; multi-kernel convolution; MS-SSIM; PERFORMANCE; NETWORK; FRAMEWORK;
D O I
10.1109/ACCESS.2023.3348789
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion (IVIF) aims to synthesize images that capitalize on the strengths of both modalities. Addressing the common challenge in IVIF of preserving thermal radiation from infrared and textural details from visible images, we introduce AMFusionNet. AMFusionNet uniquely combines a multi-kernel convolution block (MKCBlock) with parallel spatial attention and channel attention modules (PSCNet), streamlining the feature extraction process. This integration enhances the model's ability to simultaneously capture essential details from both image types. Additionally, we incorporate a multi-scale structural similarity (MS-SSIM) loss function in our comprehensive loss function to further refine the detail preservation in the fused images. Our experimental evaluations on the TNO and FLIR datasets demonstrate that AMFusionNet achieves superior performance in both objective and subjective assessments compared to recent methods.
引用
收藏
页码:8359 / 8372
页数:14
相关论文
共 50 条
  • [1] Prompt learning and multi-scale attention for infrared and visible image fusion
    Li, Yanan
    Ji, Qingtao
    Jiao, Shaokang
    INFRARED PHYSICS & TECHNOLOGY, 2025, 145
  • [2] GLMAFuse: A Dual-Stream Infrared and Visible Image Fusion Framework Integrating Local and Global Features with Multi-Scale Attention
    Li, Fu
    Gu, Yanghai
    Zhao, Ming
    Chen, Deji
    Wang, Quan
    ELECTRONICS, 2024, 13 (24):
  • [3] Infrared and visible image fusion based on multi-scale dense attention connection network
    Chen Y.
    Zhang J.
    Wang Z.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2022, 30 (18): : 2253 - 2266
  • [4] MFT: Multi-scale Fusion Transformer for Infrared and Visible Image Fusion
    Zhang, Chen-Ming
    Yuan, Chengbo
    Luo, Yong
    Zhou, Xin
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT VI, 2023, 14259 : 485 - 496
  • [5] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    Infrared Physics and Technology, 2022, 125
  • [6] Multi-scale unsupervised network for infrared and visible image fusion based on joint attention mechanism
    Xu, Dongdong
    Zhang, Ning
    Zhang, Yuxi
    Li, Zheng
    Zhao, Zhikang
    Wang, Yongcheng
    INFRARED PHYSICS & TECHNOLOGY, 2022, 125
  • [7] Infrared and visible image fusion based on saliency detection and deep multi-scale orientational features
    Liu, Gang
    Jia, Menghan
    Wang, Xiao
    Bavirisetti, Durga
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (01)
  • [8] Remote Sensing Image Registration Integrating Attention and Multi-Scale Features
    Ni, Lizheng
    Chen, Ying
    Li, Xiang
    Deng, Xiuhan
    Ma, Teng
    Computer Engineering and Applications, 61 (03): : 275 - 285
  • [9] Fusion of visible and infrared images based on multi-scale image enhancement
    Sun, Ming-Chao
    Zhang, Chong
    Liu, Jing-Hong
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2012, 42 (03): : 738 - 742
  • [10] A multi-scale information integration framework for infrared and visible image fusion
    Yang, Guang
    Li, Jie
    Lei, Hanxiao
    Gao, Xinbo
    NEUROCOMPUTING, 2024, 600