An image fusion algorithm based on image clustering theory: An image fusion algorithm based on image clustering theory: L. Zhao et al.

被引:0
作者
Liangjun Zhao [1 ]
Yinqing Wang [2 ]
Yueming Hu [1 ]
Hui Dai [3 ]
Yubin Xi [4 ]
Feng Ning [5 ]
Zhongliang He [1 ]
Gang Liang [1 ]
Yuanyang Zhang [1 ]
机构
[1] Sichuan University of Science and Engineering, Yibin
[2] Sichuan Key Provincial Research Base of Intelligent Tourism, Yibin
[3] School of Tropical Agriculture and Forestry, Hainan University, Hainan Province, Haikou
[4] School of Information and Communication Engineering, Hainan University, Hainan Province, Haikou
[5] Changsha City Planning Information Service Center, Hunan Province, Changsha
关键词
Complementary information fusion; Fusion rules; Image fusion; Multi-scale feature extraction;
D O I
10.1007/s00371-024-03736-1
中图分类号
学科分类号
摘要
The fusion of infrared and visible light images aims to combine the advantages of both, in order to obtain a fused image with clear and textured targets. This article proposes a multi-scale image fusion method based on robust self-sparse fuzzy clustering. This method combines regularization techniques under Gaussian metrics to obtain sparse fuzzy membership degrees and automatically recognizes and eliminates noise interference. At the same time, connected component filtering based on a regional density balance strategy adaptively eliminates small domain interference, effectively extracting texture and target information from images. In terms of fusion strategy, we adopt morphological heterogeneity processing to balance the contrast between infrared and visible light, enriching the underlying image by utilizing the differential information between infrared and visible light images. Subsequently, the high-frequency components in the infrared and visible light images are linearly combined to maximize the preservation of infrared target information and visible light detail textures, achieving clear and rich fused images. Finally, through qualitative and quantitative analysis using existing advanced fusion methods on public datasets, it is demonstrated that our method not only successfully preserves target information in infrared images but also captures details and texture information in visible light images during the fusion process, resulting in clearer fusion images. The codes in this article are accessible at https://github.com/baidifeizi/FS.git. © The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature 2024.
引用
收藏
页码:5517 / 5537
页数:20
相关论文
共 51 条
  • [1] Li J., Et al., Automatic detection and classification system of domestic waste via multimodel cascaded convolutional neural network, IEEE Trans. Ind. Inf, 18, 1, pp. 163-173, (2021)
  • [2] Lin X., Et al., EAPT: efficient attention pyramid transformer for image processing, IEEE Trans. Multimed, 25, pp. 50-61, (2021)
  • [3] Sheng B., Et al., Intrinsic image decomposition with step and drift shading separation, IEEE Trans. Vis. Comput. Graph, 26, 2, pp. 1332-1346, (2018)
  • [4] Cheng Z., Yang Q., Sheng B., Deep colorization, . In: Proceedings of the IEEE International Conference on Computer Vision., (2015)
  • [5] Qin Y., Et al., UrbanEvolver: Function-aware urban layout regeneration, Int. J. Comput. Vis., pp. 1-20, (2024)
  • [6] Simone G., Et al., Image fusion techniques for remote sensing applications, Inf. Fus, 3, 1, pp. 3-15, (2002)
  • [7] Zhao J., Et al., Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition, Infrared Phys. Technol, 56, pp. 93-99, (2013)
  • [8] Du Q., Et al., Fusing infrared and visible images of different resolutions via total variation model, Sensors, 18, 11, (2018)
  • [9] Qian B., Et al., DRAC 2022: A public benchmark for diabetic retinopathy analysis on ultra-wide optical coherence tomography angiography images, Patterns, (2024)
  • [10] Zhao L., Et al., Infrared and visible image fusion algorithm based on spatial domain and image features, PLoS ONE, 17, 12, (2022)