Interactive Feature Embedding for Infrared and Visible Image Fusion

被引:8
|
作者
Zhao, Fan [1 ]
Zhao, Wenda [2 ,3 ]
Lu, Huchuan [2 ,3 ]
机构
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Image fusion; Task analysis; Image reconstruction; Fuses; Self-supervised learning; Data mining; Hierarchical representations; infrared and visible image fusion; interactive feature embedding; self-supervised learning; MULTI-FOCUS; SPARSE REPRESENTATION; SHEARLET TRANSFORM; DECOMPOSITION; ENHANCEMENT; INFORMATION; FRAMEWORK;
D O I
10.1109/TNNLS.2023.3264911
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
引用
收藏
页码:12810 / 12822
页数:13
相关论文
共 50 条
  • [41] AFSFusion: An Adjacent Feature Shuffle Combination Network for Infrared and Visible Image Fusion
    Hu, Yufeng
    Xu, Shaoping
    Cheng, Xiaohui
    Zhou, Changfei
    Xiong, Minghai
    APPLIED SCIENCES-BASEL, 2023, 13 (09):
  • [42] Infrared and visible image fusion based on variational auto-encoder and infrared feature compensation
    Ren, Long
    Pan, Zhibin
    Cao, Jianzhong
    Liao, Jiawen
    INFRARED PHYSICS & TECHNOLOGY, 2021, 117
  • [43] SIE: infrared and visible image fusion based on scene information embedding
    Geng Y.
    Diao W.
    Zhao Y.
    Multimedia Tools and Applications, 2025, 84 (3) : 1463 - 1488
  • [44] An Infrared and Visible Image Fusion Algorithm Based on LSWT-NSST
    Li Junwu
    Li, Binhua
    Jiang, Yaoxi
    IEEE ACCESS, 2020, 8 : 179857 - 179880
  • [45] STFNet: Self-Supervised Transformer for Infrared and Visible Image Fusion
    Liu, Qiao
    Pi, Jiatian
    Gao, Peng
    Yuan, Di
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024, 8 (02): : 1513 - 1526
  • [46] HitFusion: Infrared and Visible Image Fusion for High-Level Vision Tasks Using Transformer
    Chen, Jun
    Ding, Jianfeng
    Ma, Jiayi
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 10145 - 10159
  • [47] OSFusion: A One-Stream Infrared and Visible Image Fusion Framework
    An, Shengjia
    Li, Zhi
    Zhang, Shaorong
    Wang, Yongjun
    Zhong, Bineng
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 1086 - 1090
  • [48] Classification Saliency-Based Rule for Visible and Infrared Image Fusion
    Xu, Han
    Zhang, Hao
    Ma, Jiayi
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 : 824 - 836
  • [49] EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement
    Zhang, Xin
    Wang, Xia
    Yan, Changda
    Sun, Qiyang
    IEEE SENSORS JOURNAL, 2024, 24 (04) : 4920 - 4934
  • [50] Attribute filter based infrared and visible image fusion
    Mo, Yan
    Kang, Xudong
    Duan, Puhong
    Sun, Bin
    Li, Shutao
    INFORMATION FUSION, 2021, 75 : 41 - 54