共 50 条
Interactive Feature Embedding for Infrared and Visible Image Fusion
被引:8
|作者:
Zhao, Fan
[1
]
Zhao, Wenda
[2
,3
]
Lu, Huchuan
[2
,3
]
机构:
[1] Liaoning Normal Univ, Sch Phys & Elect Technol, Dalian 116029, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
基金:
中国国家自然科学基金;
关键词:
Feature extraction;
Image fusion;
Task analysis;
Image reconstruction;
Fuses;
Self-supervised learning;
Data mining;
Hierarchical representations;
infrared and visible image fusion;
interactive feature embedding;
self-supervised learning;
MULTI-FOCUS;
SPARSE REPRESENTATION;
SHEARLET TRANSFORM;
DECOMPOSITION;
ENHANCEMENT;
INFORMATION;
FRAMEWORK;
D O I:
10.1109/TNNLS.2023.3264911
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well-designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in a self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of a self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
引用
收藏
页码:12810 / 12822
页数:13
相关论文