Interactive Feature Embedding for Infrared and Visible Image Fusion

被引:8
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ,3 ]
Lu, Huchuan [2 ,3 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Task analysis; Image reconstruction; Fuses; Self-supervised learning; Data mining; Hierarchical representations; infrared and visible image fusion; interactive feature embedding; self-supervised learning; MULTI-FOCUS; SPARSE REPRESENTATION; SHEARLET TRANSFORM; DECOMPOSITION; ENHANCEMENT; INFORMATION; FRAMEWORK;
D O I
10.1109/TNNLS.2023.3264911
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
引用
收藏
页码:12810 / 12822
页数:13
相关论文
共 50 条
  • [31] Cross-Modal Transformers for Infrared and Visible Image Fusion
    Park, Seonghyun
    Vien, An Gia
    Lee, Chul
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 770 - 785
  • [32] Denoiser Learning for Infrared and Visible Image Fusion
    Liu, Jinyang
    Li, Shutao
    Tan, Lishan
    Dian, Renwei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [33] CAMF: An Interpretable Infrared and Visible Image Fusion Network Based on Class Activation Mapping
    Tang, Linfeng
    Chen, Ziang
    Huang, Jun
    Ma, Jiayi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4776 - 4791
  • [34] Low-Light Infrared and Visible Image Fusion With Imbalanced Thermal Radiation Distribution
    Lei, Xinyu
    Liu, Longjun
    Jia, Puhang
    Li, Haoteng
    Zhang, Haonan
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [35] PS-GAN: Pseudo Supervised Generative Adversarial Network With Single Scale Retinex Embedding for Infrared and Visible Image Fusion
    Qi, Jin
    Abera, Deboch Eyob
    Cheng, Jian
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 1766 - 1777
  • [36] CCAFusion: Cross-Modal Coordinate Attention Network for Infrared and Visible Image Fusion
    Li, Xiaoling
    Li, Yanfeng
    Chen, Houjin
    Peng, Yahui
    Pan, Pan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 866 - 881
  • [37] Optimizing Nighttime Infrared and Visible Image Fusion for Long-haul Tactile Internet
    Song, Wenhao
    Gao, Mingliang
    Li, Qilei
    Guo, Xiangyu
    Wang, Zenghui
    Jeon, Gwanggil
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 4277 - 4286
  • [38] Infrared and visible image fusion and detection based on interactive training strategy and feature filter extraction module
    Chen, Bingxin
    Luo, Shaojuan
    Wu, Heng
    Chen, Meiyun
    He, Chunhua
    OPTICS AND LASER TECHNOLOGY, 2024, 179
  • [39] MSFNet: MultiStage Fusion Network for infrared and visible image fusion
    Wang, Chenwu
    Wu, Junsheng
    Zhu, Zhixiang
    Chen, Hao
    NEUROCOMPUTING, 2022, 507 : 26 - 39
  • [40] SFINet: A semantic feature interactive learning network for full-time infrared and visible image fusion
    Song, Wenhao
    Li, Qilei
    Gao, Mingliang
    Chehri, Abdellah
    Jeon, Gwanggil
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 261