Infrared and visible image fusion based on a two-stage fusion strategy and feature interaction block

被引:0
|
作者
Chen, Bingxin [1 ,2 ]
Luo, Shaojuan [3 ]
Chen, Meiyun [1 ]
Zhang, Fanlong [1 ,2 ]
He, Chunhua [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Neural network; Optical imaging; Image processing;
D O I
10.1016/j.optlaseng.2024.108461
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Infrared and visible image fusion technology (IVIFT) can combine the advantages of infrared and visible imaging systems and reduce the influence of particular environments, such as snow, darkness, fog, etc. Therefore, IVIFT is widely applied in security inspection, night monitoring, and remote sensing. However, many existing methods utilize a single-stage approach to optimize the model, which often causes weak robustness and an imbalance between the intensity and detail information. To solve this issue, we propose an infrared and visible image fusion method based on a two-stage fusion strategy and a feature interaction block (TFfusion). Specifically, a two-stage fusion strategy is developed to balance the salient target and the texture information retaining. The texture information is fused in Stage I, the salient targets are fused in Stage II, and Stage I guides Stage II in extracting texture information. A feature interaction block is designed to enhance the correlation between the source images and the fused image by sharing the features with each other. Quantitative and qualitative experiment results demonstrate that TFfusion achieves competitive performance and strong robustness in fusing the infrared and visible images compared with other advanced fusion methods.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] A three-dimensional feature-based fusion strategy for infrared and visible image fusion
    Liu, Xiaowen
    Huo, Hongtao
    Yang, Xin
    Li, Jing
    PATTERN RECOGNITION, 2025, 157
  • [2] Infrared and visible image fusion and detection based on interactive training strategy and feature filter extraction module
    Chen, Bingxin
    Luo, Shaojuan
    Wu, Heng
    Chen, Meiyun
    He, Chunhua
    OPTICS AND LASER TECHNOLOGY, 2024, 179
  • [3] HF2TNet: A Hierarchical Fusion Two-Stage Training Network for Infrared and Visible Image Fusion
    Lv, Ting
    Ji, Chuanming
    Jiang, Hong
    Liu, Yu
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3164 - 3168
  • [4] Infrared and visible image fusion based on a two-stage class conditioned auto-encoder network
    Cao, Yanpeng
    Luo, Xing
    Tong, Xi
    Yang, Jiangxin
    Cao, Yanlong
    NEUROCOMPUTING, 2023, 544
  • [5] Infrared and Visible Image Fusion Based on Adaptive Feature Enhancement and Generator Path Interaction
    Yejun, Yang
    Gang, Liu
    Gang, Xiao
    Xinjie, Gu
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (14)
  • [6] FDFuse: Infrared and Visible Image Fusion Based on Feature Decomposition
    Cheng, Muhang
    Huang, Haiyan
    Liu, Xiangyu
    Mo, Hongwei
    Wu, Songling
    Zhao, Xiongbo
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [7] Infrared and Visible Image Fusion via Attention-Based Adaptive Feature Fusion
    Wang, Lei
    Hu, Ziming
    Kong, Quan
    Qi, Qian
    Liao, Qing
    ENTROPY, 2023, 25 (03)
  • [8] IBFusion: An Infrared and Visible Image Fusion Method Based on Infrared Target Mask and Bimodal Feature Extraction Strategy
    Bai, Yang
    Gao, Meijing
    Li, Shiyu
    Wang, Ping
    Guan, Ning
    Yin, Haozheng
    Yan, Yonghao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10610 - 10622
  • [9] Fusion of infrared and visible images based on image enhancement and feature extraction
    Luo, Jinzhe
    Rong, Chuanzhen
    Jia, Yongxing
    Yang, Yu
    Zhu, Ying
    2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 1, 2019, : 212 - 216
  • [10] Infrared and Visible Image Fusion Algorithm Based on Feature Optimization and GAN
    Hao Shuai
    Li Jiahao
    Ma Xu
    He Tian
    Sun Siyan
    Li Tong
    ACTA PHOTONICA SINICA, 2023, 52 (12)