Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion

被引:1
|
作者
Xu, Qian [1 ]
Zheng, Yuan [2 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Peoples R China
[2] Civil Aviat Flight Univ China, Sch Comp Sci, Guanghan 618311, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared and visible image fusion; parallel attention mechanism; multi-kernel convolution; MS-SSIM; PERFORMANCE; NETWORK; FRAMEWORK;
D O I
10.1109/ACCESS.2023.3348789
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Infrared and visible image fusion (IVIF) aims to synthesize images that capitalize on the strengths of both modalities. Addressing the common challenge in IVIF of preserving thermal radiation from infrared and textural details from visible images, we introduce AMFusionNet. AMFusionNet uniquely combines a multi-kernel convolution block (MKCBlock) with parallel spatial attention and channel attention modules (PSCNet), streamlining the feature extraction process. This integration enhances the model's ability to simultaneously capture essential details from both image types. Additionally, we incorporate a multi-scale structural similarity (MS-SSIM) loss function in our comprehensive loss function to further refine the detail preservation in the fused images. Our experimental evaluations on the TNO and FLIR datasets demonstrate that AMFusionNet achieves superior performance in both objective and subjective assessments compared to recent methods.
引用
收藏
页码:8359 / 8372
页数:14
相关论文
共 50 条
  • [31] Image Inpainting with EMMA Attention and Multi-scale Fusion
    Wei, Yun
    Wang, Lulu
    Wu, Kaijun
    Shan, Hongquan
    Tian, Bin
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2024, 51 (12): : 87 - 97
  • [32] Hyperspectral Image Classification Based on Multi-Scale Convolutional Features and Multi-Attention Mechanisms
    Sun, Qian
    Zhao, Guangrui
    Xia, Xinyuan
    Xie, Yu
    Fang, Chenrong
    Sun, Le
    Wu, Zebin
    Pan, Chengsheng
    REMOTE SENSING, 2024, 16 (12)
  • [33] Medical image fusion by combining parallel features on multi-scale local extrema scheme
    Du, Jiao
    Li, Weisheng
    Xiao, Bin
    Nawaz, Qamar
    KNOWLEDGE-BASED SYSTEMS, 2016, 113 : 4 - 12
  • [34] Infrared and visible image fusion via multi-scale multi-layer rolling guidance filter
    G. Prema
    S. Arivazhagan
    Pattern Analysis and Applications, 2022, 25 : 933 - 950
  • [35] Infrared and visible image fusion via multi-scale multi-layer rolling guidance filter
    Prema, G.
    Arivazhagan, S.
    PATTERN ANALYSIS AND APPLICATIONS, 2022, 25 (04) : 933 - 950
  • [36] Bridge Crack Segmentation Method Based on Parallel Attention Mechanism and Multi-Scale Features Fusion
    Yuan, Jianwei
    Song, Xinli
    Pu, Huaijian
    Zheng, Zhixiong
    Niu, Ziyang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (03): : 6485 - 6503
  • [37] BDMFuse: Multi-scale network fusion for infrared and visible images based on base and detail features
    Si, Hai-Ping
    Zhao, Wen-Rui
    Li, Ting-Ting
    Li, Fei-Tao
    Fernado, Bacao
    Sun, Chang-Xia
    Li, Yan-Ling
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2025, 44 (02) : 275 - 284
  • [38] MAXFormer: Enhanced transformer for medical image segmentation with multi-attention and multi-scale features fusion
    Liang, Zhiwei
    Zhao, Kui
    Liang, Gang
    Li, Siyu
    Wu, Yifei
    Zhou, Yiping
    KNOWLEDGE-BASED SYSTEMS, 2023, 280
  • [39] An end-to-end multi-scale network based on autoencoder for infrared and visible image fusion
    Liu, Hongzhe
    Yan, Hua
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (13) : 20139 - 20156
  • [40] Infrared and Visible Image Fusion via Rolling Guidance Filtering and Hybrid Multi-Scale Decomposition
    Zhao Cheng
    Huang Yongdong
    LASER & OPTOELECTRONICS PROGRESS, 2019, 56 (14)