Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion

被引:1
作者
Xu, Qian [1 ]
Zheng, Yuan [2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
[2] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618311, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; parallel attention mechanism; multi-kernel convolution; MS-SSIM; PERFORMANCE; NETWORK; FRAMEWORK;
D O I
10.1109/ACCESS.2023.3348789
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion (IVIF) aims to synthesize images that capitalize on the strengths of both modalities. Addressing the common challenge in IVIF of preserving thermal radiation from infrared and textural details from visible images, we introduce AMFusionNet. AMFusionNet uniquely combines a multi-kernel convolution block (MKCBlock) with parallel spatial attention and channel attention modules (PSCNet), streamlining the feature extraction process. This integration enhances the model's ability to simultaneously capture essential details from both image types. Additionally, we incorporate a multi-scale structural similarity (MS-SSIM) loss function in our comprehensive loss function to further refine the detail preservation in the fused images. Our experimental evaluations on the TNO and FLIR datasets demonstrate that AMFusionNet achieves superior performance in both objective and subjective assessments compared to recent methods.
引用
收藏
页码:8359 / 8372
页数:14
相关论文
共 50 条
  • [21] High-security image steganography integrating multi-scale feature fusion with residual attention mechanism
    Liang, Jiaqi
    Xie, Wei
    Wu, Haotian
    Zhao, Junfeng
    Song, Xianhua
    NEUROCOMPUTING, 2025, 632
  • [22] DFA-Net: Multi-Scale Dense Feature-Aware Network via Integrated Attention for Unmanned Aerial Vehicle Infrared and Visible Image Fusion
    Shen, Sen
    Li, Di
    Mei, Liye
    Xu, Chuan
    Ye, Zhaoyi
    Zhang, Qi
    Hong, Bo
    Yang, Wei
    Wang, Ying
    DRONES, 2023, 7 (08)
  • [23] Multi-scale decomposition based fusion of infrared and visible image via total variation and saliency analysis
    Ma, Tao
    Ma, Jie
    Fang, Bin
    Hu, Fangyu
    Quan, Siwen
    Du, Huajun
    INFRARED PHYSICS & TECHNOLOGY, 2018, 92 : 154 - 162
  • [24] An infrared and visible image fusion method based upon multi-scale and top-hat transforms
    He, Gui-Qing
    Zhang, Qi-Qi
    Ji, Jia-Qi
    Dong, Dan-Dan
    Zhang, Hai-Xi
    Wang, Jun
    CHINESE PHYSICS B, 2018, 27 (11)
  • [25] Infrared and visible image fusion based on double fluid pyramids and multi-scale gradient residual block
    Pang, Shan
    Huo, Hongtao
    Yang, Xin
    Li, Jing
    Liu, Xiaowen
    INFRARED PHYSICS & TECHNOLOGY, 2023, 131
  • [26] An infrared and visible image fusion method based upon multi-scale and top-hat transforms
    何贵青
    张琪琦
    纪佳琪
    董丹丹
    张海曦
    王珺
    Chinese Physics B, 2018, (11) : 344 - 352
  • [27] Infrared and Visible Image Fusion Based on Multi-scale Network with Dual-channel Information Cross Fusion Block
    Yang, Yong
    Kong, Xiangkai
    Huang, Shuying
    Wan, Weiguo
    Liu, Jiaxiang
    Zhang, Wang
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [28] Multi-Level Adaptive Attention Fusion Network for Infrared and Visible Image Fusion
    Hu, Ziming
    Kong, Quan
    Liao, Qing
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 366 - 370
  • [29] AEFusion: A multi-scale fusion network combining Axial attention and Entropy feature Aggregation for infrared and visible images
    Li, Bicao
    Lu, Jiaxi
    Liu, Zhoufeng
    Shao, Zhuhong
    Li, Chunlei
    Du, Yifan
    Huang, Jie
    APPLIED SOFT COMPUTING, 2023, 132
  • [30] Knowledge Fusion Distillation: Improving Distillation with Multi-scale Attention Mechanisms
    Li, Linfeng
    Su, Weixing
    Liu, Fang
    He, Maowei
    Liang, Xiaodan
    NEURAL PROCESSING LETTERS, 2023, 55 (05) : 6165 - 6180