LiMFusion: Infrared and visible image fusion via local information measurement

被引:2
|
作者
Qian, Yao [1 ]
Tang, Haojie [2 ]
Liu, Gang [1 ]
Xiao, Gang [3 ]
Bavirisetti, Durga Prasad [4 ]
机构
[1] Shanghai Univ Elect Power, Sch Automat Engn, Shanghai 200082, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Lab Aerial Informat Probe & Intelligent Percept, Chengdu 610065, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Aeronaut & Astronaut, Shanghai 200240, Peoples R China
[4] Norwegian Univ Sci & Technol, Fac Informat Technol & Elect Engn, N-7034 Trondheim, Norway
基金
中国国家自然科学基金;
关键词
Local information measurement; Attention mechanism; Image fusion; Histogram of oriented gradients; MULTI-FOCUS; NETWORK;
D O I
10.1016/j.optlaseng.2024.108435
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Most image fusion methods currently achieve satisfactory results under normal conditions. However, in complex scenes, the problem of information conflict between source images has not been effectively resolved. Sometimes, effective information from one source image may be masked by noise from another source image. In this paper, by organically combining the traditional decomposition strategy and the attention mechanism, we propose a novel infrared and visible image fusion network based on local information measurement, named LiMFusion. Specifically, the source image is decomposed by utilizing fourth-order partial differential equations to obtain high-frequency and low-frequency layers. Feature representation and information preservation capabilities are enhanced by well-designed spatial attention blocks as well as channel attention blocks combined with the UNet architecture. Moreover, a new localized image information measurement method based on histogram of oriented gradients and a spatial-aware loss function are proposed to make the fusion network more inclined to focus on the features of the region of interest. Extensive experimental results indicate that this method can more comprehensively reflect the brightness information and texture details of the source image, effectively addressing the challenges of fusion in complex environments. The source code will be publicly available at https://github . com /YQ -097 /LiMFusion.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] A multi-scale information integration framework for infrared and visible image fusion
    Yang, Guang
    Li, Jie
    Lei, Hanxiao
    Gao, Xinbo
    NEUROCOMPUTING, 2024, 600
  • [42] Infrared and visible image fusion based on iterative differential thermal information filter
    Chen, Yanling
    Cheng, Lianglun
    Wu, Heng
    Mo, Fei
    Chen, Ziyang
    OPTICS AND LASERS IN ENGINEERING, 2022, 148
  • [43] A Novel Infrared and Visible Image Information Fusion Method Based on Phase Congruency and Image Entropy
    Huang, Xinghua
    Qi, Guanqiu
    Wei, Hongyan
    Chai, Yi
    Sim, Jaesung
    ENTROPY, 2019, 21 (12)
  • [44] Infrared and Visible Image Fusion with Hybrid Image Filtering
    Zhang, Yongxin
    Li, Deguang
    Zhu, WenPeng
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2020, 2020
  • [45] Exploring fusion domain: Advancing infrared and visible image fusion via IDFFN-GAN
    Li, Juan
    Shi, Xiaoqian
    Li, Yanan
    Zhou, Huabing
    NEUROCOMPUTING, 2025, 611
  • [46] Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning
    Wang, Zhishe
    Shao, Wenyu
    Chen, Yanlin
    Xu, Jiawei
    Zhang, Xiaoqin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7800 - 7813
  • [47] Infrared and Visible Image Fusion Method via Interactive Self-attention
    Yang Fan
    Wang Zhishe
    Sun Jing
    Yu Zhaofa
    ACTA PHOTONICA SINICA, 2024, 53 (06)
  • [48] Infrared and visible image fusion via dual encoder based on dense connection
    Lu, Quan
    Zhang, Hongbin
    Yin, Linfei
    PATTERN RECOGNITION, 2025, 163
  • [49] Lightweight Infrared and Visible Image Fusion via Adaptive DenseNet with Knowledge Distillation
    Zhao, Zongqing
    Su, Shaojing
    Wei, Junyu
    Tong, Xiaozhong
    Gao, Weijia
    ELECTRONICS, 2023, 12 (13)
  • [50] FCGP: Infrared and Visible Image Fusion via Joint Contrast and Gradient Preservation
    Yan, Huibin
    Wang, Shuoyao
    IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 2038 - 2042