共 50 条
LiMFusion: Infrared and visible image fusion via local information measurement
被引:2
|作者:
Qian, Yao
[1
]
Tang, Haojie
[2
]
Liu, Gang
[1
]
Xiao, Gang
[3
]
Bavirisetti, Durga Prasad
[4
]
机构:
[1] Shanghai Univ Elect Power, Sch Automat Engn, Shanghai 200082, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Lab Aerial Informat Probe & Intelligent Percept, Chengdu 610065, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Aeronaut & Astronaut, Shanghai 200240, Peoples R China
[4] Norwegian Univ Sci & Technol, Fac Informat Technol & Elect Engn, N-7034 Trondheim, Norway
基金:
中国国家自然科学基金;
关键词:
Local information measurement;
Attention mechanism;
Image fusion;
Histogram of oriented gradients;
MULTI-FOCUS;
NETWORK;
D O I:
10.1016/j.optlaseng.2024.108435
中图分类号:
O43 [光学];
学科分类号:
070207 ;
0803 ;
摘要:
Most image fusion methods currently achieve satisfactory results under normal conditions. However, in complex scenes, the problem of information conflict between source images has not been effectively resolved. Sometimes, effective information from one source image may be masked by noise from another source image. In this paper, by organically combining the traditional decomposition strategy and the attention mechanism, we propose a novel infrared and visible image fusion network based on local information measurement, named LiMFusion. Specifically, the source image is decomposed by utilizing fourth-order partial differential equations to obtain high-frequency and low-frequency layers. Feature representation and information preservation capabilities are enhanced by well-designed spatial attention blocks as well as channel attention blocks combined with the UNet architecture. Moreover, a new localized image information measurement method based on histogram of oriented gradients and a spatial-aware loss function are proposed to make the fusion network more inclined to focus on the features of the region of interest. Extensive experimental results indicate that this method can more comprehensively reflect the brightness information and texture details of the source image, effectively addressing the challenges of fusion in complex environments. The source code will be publicly available at https://github . com /YQ -097 /LiMFusion.
引用
收藏
页数:13
相关论文