Interactive Feature Embedding for Infrared and Visible Image Fusion

被引:8
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ,3 ]
Lu, Huchuan [2 ,3 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Task analysis; Image reconstruction; Fuses; Self-supervised learning; Data mining; Hierarchical representations; infrared and visible image fusion; interactive feature embedding; self-supervised learning; MULTI-FOCUS; SPARSE REPRESENTATION; SHEARLET TRANSFORM; DECOMPOSITION; ENHANCEMENT; INFORMATION; FRAMEWORK;
D O I
10.1109/TNNLS.2023.3264911
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
引用
收藏
页码:12810 / 12822
页数:13
相关论文
共 50 条
  • [1] Self-supervised feature adaption for infrared and visible image fusion
    Zhao, Fan
    Zhao, Wenda
    Yao, Libo
    Liu, Yu
    INFORMATION FUSION, 2021, 76 : 189 - 203
  • [2] Infrared and Visible Image Fusion via General Feature Embedding From CLIP and DINOv2
    Luo, Yichuang
    Wang, Fang
    Liu, Xiaohu
    IEEE ACCESS, 2024, 12 : 99362 - 99371
  • [3] FDFuse: Infrared and Visible Image Fusion Based on Feature Decomposition
    Cheng, Muhang
    Huang, Haiyan
    Liu, Xiangyu
    Mo, Hongwei
    Wu, Songling
    Zhao, Xiongbo
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [4] Infrared and Visible Image Fusion Technology and Application: A Review
    Ma, Weihong
    Wang, Kun
    Li, Jiawei
    Yang, Simon X.
    Li, Junfei
    Song, Lepeng
    Li, Qifeng
    SENSORS, 2023, 23 (02)
  • [5] RITFusion: Reinforced Interactive Transformer Network for Infrared and Visible Image Fusion
    Li, Xiaoling
    Li, Yanfeng
    Chen, Houjin
    Peng, Yahui
    Chen, Luyifu
    Wang, Minjun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 16
  • [6] Multiscale Feature Interactive Network for Multifocus Image Fusion
    Liu, Yu
    Wang, Lei
    Cheng, Juan
    Chen, Xun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [7] Two-Level Consistency Metric for Infrared and Visible Image Fusion
    Lin, Xiaopeng
    Zhou, Guanxing
    Tu, Xiaotong
    Huang, Yue
    Ding, Xinghao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [8] An Infrared and Visible Image Fusion Approach of Self-calibrated Residual Networks and Feature Embedding
    Dai J.
    Luo Z.
    Li C.
    Recent Advances in Computer Science and Communications, 2023, 16 (02) : 2 - 13
  • [9] Adjustable Visible and Infrared Image Fusion
    Wu, Boxiong
    Nie, Jiangtao
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 13463 - 13477
  • [10] IFICI: Infrared and visible image fusion based on interactive compensation illumination
    Liang, Lei
    Shen, Xing
    Gao, Zhisheng
    INFRARED PHYSICS & TECHNOLOGY, 2024, 136