Infrared and low-light image fusion based on VGG19 and low-pass filtering

被引：0
|
作者：
Liu Z.-Z. [1 ]
Sun C.-X. [2 ]
Wang X.-Z. [3 ]
Zhang Y.-M. [4 ]
机构：
[1] School of Computer Science, Xi'An Aeronautical University, Xi'an
[2] No. 29 Research Institute of CETC, Chengdu
[3] School of Data Sciences, The Chinese University of Hong Kong(Shenzhen), Shenzhen
[4] School of Electronic Engineering, Xi'An Aeronautical University, Xi'an
来源：
Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition) | 2023年 / 53卷 / 01期
关键词：
fusion algorithm; infrared image; low-light image; low-pass filtering; VGG network;
D O I：
10.13229/j.cnki.jdxbgxb20210542
中图分类号：
学科分类号：
摘要：
Due to the current single sensor being affected by its imaging performance, it is often difficult to fully reflect all the effective information in the ground object scene, resulting in the problem that the scene information is difficult to accurately identify, so a new infrared and low light image fusion algorithm based on VGG and low-pass filtering is proposed. Firstly, obtain the ground object scene information through infrared and low-level light detectors, use three-dimensional distribution, histogram comparison, and inversion to process the image, analyze the target characteristics of infrared and low-level light images, and study the spectroscopic mechanism of dual-frequency images; On this basis, the low-pass filtering method is used to decompose the infrared and low-light images to obtain their contour information and salient information. The contour part adopts the average weighting strategy for fusion, and the significant part adopts the VGG strategy for multi-layer fusion, and then the reconstructed image is fused; Finally, it is compared with the results of other algorithms, and the performance evaluation method is used to evaluate each fusion algorithm. The experimental results show that the algorithm can enhance the gray level of the scene information in the image, improve the brightness of the scene, and solve the problem of anti background interference of the scene information in the single frequency image. © 2023 Editorial Board of Jilin University. All rights reserved.
引用
收藏
页码：255 / 262
页数：7
相关论文
共 17 条
  • [1] Sharma A M, Dogra A, Goyal B, Low-light visible and infrared image fusion in NSST domain, Proceedings of International Conference on IoT Inclusive Life, pp. 61-68, (2020)
  • [2] Huang Yi-dong, Fusion of infrared and low-level light images in realistic scene, (2003)
  • [3] Zhang Z, Li H, Zhao G., Bionic algorithm for color fusion of infrared and low light level image based on rattlesnake bimodal cells, IEEE Access, 6, pp. 68981-68988, (2018)
  • [4] Wang X, Yin J, Zhang K, Et al., Infrared weak-small targets fusion based on latent low-rank representation and DWT, IEEE Access, 7, pp. 112681-112692, (2019)
  • [5] Hu Qing-ping, Zhang Xiao-hui, Liu Chao, Adaptive fusion method of low light level and infrared image based on noise analysis, lournal of Naval University of Engineering, 29, 1, pp. 102-106, (2017)
  • [6] Vijayarajan R, Nagarajan S, Karthik R, Et al., Perfor-mance analysis of VGG19 deep learning network based Brain image fusion, Handbook of Research on Deep Learning-Based Image Analysis Under Con-strained and Unconstrained Environments, pp. 145-166, (2020)
  • [7] Yang L, Gomez-Garcia R, Munoz-Ferrer J M, Et al., Input-reflectionless low-pass filter on multilay-ered diplexer-based topology, IEEE Microwave and Wireless Components Letters, 30, 10, pp. 945-948, (2020)
  • [8] Li H, Wu X J., Infrared and visible image fusion using a novel deep decomposition method [DB/OL]
  • [9] Chen W B, Hu M, Zhou L, Et al., Fusion algorithm of multi-focus images with weighted ratios and weighted gradient based on wavelet transform, Journal of Intelligent Systems, 28, 4, pp. 505-516, (2019)
  • [10] Nikbakhsh N, Baleghl Y, Agahi H., Maximum mutual information and Tsallis entropy for unsupervised segmentation of tree leaves in natural scenes, Com-puters and Electronics in Agriculture, 162, pp. 440-449, (2019)
12