Infrared and visible image fusion based on a two-stage fusion strategy and feature interaction block

被引:0
|
作者
Chen, Bingxin [1 ,2 ]
Luo, Shaojuan [3 ]
Chen, Meiyun [1 ]
Zhang, Fanlong [1 ,2 ]
He, Chunhua [1 ,2 ]
Wu, Heng [1 ,2 ]
机构
[1] Guangdong Univ Technol, Sch Automat, Guangdong Prov Key Lab Cyber Phys Syst, Guangzhou 510006, Peoples R China
[2] Guangdong Univ Technol, Sch Comp, Guangzhou 510006, Peoples R China
[3] Guangdong Univ Technol, Sch Chem Engn & Light Ind, Guangzhou 510006, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Neural network; Optical imaging; Image processing;
D O I
10.1016/j.optlaseng.2024.108461
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Infrared and visible image fusion technology (IVIFT) can combine the advantages of infrared and visible imaging systems and reduce the influence of particular environments, such as snow, darkness, fog, etc. Therefore, IVIFT is widely applied in security inspection, night monitoring, and remote sensing. However, many existing methods utilize a single-stage approach to optimize the model, which often causes weak robustness and an imbalance between the intensity and detail information. To solve this issue, we propose an infrared and visible image fusion method based on a two-stage fusion strategy and a feature interaction block (TFfusion). Specifically, a two-stage fusion strategy is developed to balance the salient target and the texture information retaining. The texture information is fused in Stage I, the salient targets are fused in Stage II, and Stage I guides Stage II in extracting texture information. A feature interaction block is designed to enhance the correlation between the source images and the fused image by sharing the features with each other. Quantitative and qualitative experiment results demonstrate that TFfusion achieves competitive performance and strong robustness in fusing the infrared and visible images compared with other advanced fusion methods.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition
    Ren, Long
    Pan, Zhibin
    Cao, Jianzhong
    Zhang, Hui
    Wang, Hao
    SIGNAL PROCESSING, 2021, 186
  • [42] Infrared and Visible Image Fusion Based on NSST and RDN
    Yan, Peizhou
    Zou, Jiancheng
    Li, Zhengzheng
    Yang, Xin
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2021, 28 (01) : 213 - 225
  • [43] Infrared and Visible Images Registration Using Feature and Area for Image Fusion
    Zhang, Xiuqiong
    Qin, Hongyin
    Wang, Mingrong
    Yang, Jian
    FOURTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2011): MACHINE VISION, IMAGE PROCESSING, AND PATTERN ANALYSIS, 2012, 8349
  • [44] Infrared and Visible Image Fusion Based on Image Enhancement and Rolling Guidance Filtering
    Liang Jiaming
    Yang Shen
    Tian Lifan
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (02)
  • [45] A Multi-Stage Visible and Infrared Image Fusion Network Based on Attention Mechanism
    Zheng, Xin
    Yang, Qiyong
    Si, Pengbo
    Wu, Qiang
    SENSORS, 2022, 22 (10)
  • [46] An Infrared and Visible Image Fusion Algorithm Based on MAP
    Kang Kai
    Liu Tingting
    Wang Tianyun
    Nian Fuchun
    Xu Xianchun
    17TH INTERNATIONAL CONFERENCE ON OPTICAL COMMUNICATIONS AND NETWORKS (ICOCN2018), 2019, 11048
  • [47] Adjustable Visible and Infrared Image Fusion
    Wu, Boxiong
    Nie, Jiangtao
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13463 - 13477
  • [48] RESTORABLE VISIBLE AND INFRARED IMAGE FUSION
    Kang, Jihun
    Horita, Daichi
    Tsubota, Koki
    Aizawa, Kiyoharu
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1560 - 1564
  • [49] An Infrared and Visible Image Fusion Algorithm Based on ResNet152
    Li Heng
    Zhang Liming
    Jiang Meirong
    Li Yulong
    LASER & OPTOELECTRONICS PROGRESS, 2020, 57 (08)
  • [50] An infrared and visible image fusion algorithm based on ResNet-152
    Zhang, Liming
    Li, Heng
    Zhu, Rui
    Du, Ping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (07) : 9277 - 9287