Multi-focus image fusion method based on adaptive weighting and interactive information modulation

被引:1
作者
Jiang, Jinyuan [1 ]
Zhai, Hao [1 ]
Yang, You [2 ]
Xiao, Xuan [1 ]
Wang, Xinbo [1 ]
机构
[1] Chongqing Normal Univ, Coll Comp & Informat Sci, Chongqing 401331, Peoples R China
[2] Natl Ctr Appl Math Chongqing, Chongqing 401331, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-focus image fusion; Dual-tree complex wavelet transform; Transformer; Information modulation; QUALITY ASSESSMENT; ALGORITHM; EXTRACTION;
D O I
10.1007/s00530-024-01506-6
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multi-focus image fusion is an important computer vision task aimed at synthesizing multiple images with different focal points into a single image with higher clarity and a wide depth of field. However, existing methods face challenges when dealing with complex scenes, such as information loss, edge blurring, and insufficient extraction of image detail information. To address these challenges, a multi-focus image fusion method based on adaptive weighting and interactive information modulation is proposed in this paper. Specifically, the proposed method utilizes a detail and structure information enhancement block that employs DTCWT to decompose the spectral information of the image. This approach achieves a good balance of direction selectivity, multi-scale analysis, and translation invariance, enabling efficient capture of spectral information while reducing noise interference and preserving edge information. Introducing learnable weights for adaptive weighting allows the network to adjust the importance of different frequency components to enhance feature information. Moreover, the interactive information modulation structure enhances local feature extraction through multi-level and multi-dimensional feature interaction and information flow. The paper also optimizes feature fusion to better aggregate feature information from different scales and channels, improving the network's ability to generate accurate and natural fusion results. The method's performance is evaluated based on both visual quality and objective metrics, demonstrating its superiority in multi-focus image fusion tasks compared to other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 48 条
  • [1] Multi-scale Guided Image and Video Fusion: A Fast and Efficient Approach
    Bavirisetti, Durga Prasad
    Xiao, Gang
    Zhao, Junhao
    Dhuli, Ravindra
    Liu, Gang
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2019, 38 (12) : 5576 - 5605
  • [2] A fuzzy convolutional neural network for enhancing multi-focus image fusion
    Bhalla, Kanika
    Koundal, Deepika
    Sharma, Bhisham
    Hu, Yu-Chen
    Zaguia, Atef
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 84
  • [3] Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
  • [4] Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting
    Chen, Jun
    Li, Xuejiao
    Luo, Linbo
    Ma, Jiayi
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 655 - 667
  • [5] Regional multifocus image fusion using sparse representation
    Chen, Long
    Li, Jinbo
    Chen, C. L. Philip
    [J]. OPTICS EXPRESS, 2013, 21 (04): : 5182 - 5197
  • [6] Chen Y., 2024, IEEE Sens. J
  • [7] A new automated quality assessment algorithm for image fusion
    Chen, Yin
    Blum, Rick S.
    [J]. IMAGE AND VISION COMPUTING, 2009, 27 (10) : 1421 - 1432
  • [8] Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition
    Cui, Guangmang
    Feng, Huajun
    Xu, Zhihai
    Li, Qi
    Chen, Yueting
    [J]. OPTICS COMMUNICATIONS, 2015, 341 : 199 - 209
  • [9] Image Segmentation-Based Multi-Focus Image Fusion Through Multi-Scale Convolutional Neural Network
    Du, Chaoben
    Gao, Shesheng
    [J]. IEEE ACCESS, 2017, 5 : 15750 - 15761
  • [10] Multi-focus image fusion using Content Adaptive Blurring
    Farid, Muhammad Shahid
    Mahmood, Arif
    Al-Maadeed, Somaya Ali
    [J]. INFORMATION FUSION, 2019, 45 : 96 - 112