MMFuse: A multi-scale infrared and visible images fusion algorithm based on morphological reconstruction and membership filtering

被引:1
作者
Zhao, Liangjun [1 ,4 ]
Yang, Hao [1 ]
Dong, Linlu [2 ]
Zheng, Liping [1 ]
Asiya, Manlike [3 ]
Zheng, Fengling [3 ]
机构
[1] Sichuan Univ Sci & Engn, Comp Sci & Engn, Zigong, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Informat Engn, Mianyang, Peoples R China
[3] Xinjiang Acad Anim Sci, Grassland Res Inst, Urumqi, Peoples R China
[4] Sichuan Key Prov Res Base Intelligent Tourism, Zigong, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Multi-scale transformation; Fuzzy c-means clustering(FCM); Morphological reconstruction (MR); SALIENCY ANALYSIS; PERFORMANCE; TRANSFORM; ENTROPY; LIGHT;
D O I
10.1049/ipr2.12701
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a multi-scale transformation method based on morphological reconstruction and membership filtering, termed as MMFuse, to fuse infrared and visible images. This method employs a fuzzy c-means clustering algorithm for multi-scale decomposition by introducing morphological reconstruction operations and modifying member partitions to ensure noise resistance and image detail preservation. In addition, the MMFuse utilises the image attributes of layers as their fusion weights at each scale for adaptive feature fusion, which reduces the difficulty of manual adjustment of fusion weights. Moreover, on the basis of histogram enhancement, a visible image enhancement method is proposed, which can help exploit additional texture details in low-light visible images and transfer these details to the fused image. The experiments performed on public datasets indicates that the MMFuse can generate sharp and clean fused images with high robustness and good fusion results for the images corrupted by different noises. Moreover, the results of this method appear as high-quality visible images with clear highlighted infrared targets.
引用
收藏
页码:1126 / 1148
页数:23
相关论文
共 43 条
  • [1] Bavirisetti DP, 2017, 2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), P701
  • [2] Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform
    Bavirisetti, Durga Prasad
    Dhuli, Ravindra
    [J]. IEEE SENSORS JOURNAL, 2016, 16 (01) : 203 - 209
  • [3] THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE
    BURT, PJ
    ADELSON, EH
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) : 532 - 540
  • [4] Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition
    Cui, Guangmang
    Feng, Huajun
    Xu, Zhihai
    Li, Qi
    Chen, Yueting
    [J]. OPTICS COMMUNICATIONS, 2015, 341 : 199 - 209
  • [5] From Multi-Scale Decomposition to Non-Multi-Scale Decomposition Methods: A Comprehensive Survey of Image Fusion Techniques and Its Applications
    Dogra, Ayush
    Goyal, Bhawna
    Agrawal, Sunil
    [J]. IEEE ACCESS, 2017, 5 : 16040 - 16067
  • [6] Image enhancement via texture protection Retinex
    Dong, Linlu
    Zhao, Liangjun
    Wang, Jun
    [J]. IET IMAGE PROCESSING, 2022, 16 (01) : 61 - 78
  • [7] Fusing Infrared and Visible Images of Different Resolutions via Total Variation Model
    Du, Qinglei
    Xu, Han
    Ma, Yong
    Huang, Jun
    Fan, Fan
    [J]. SENSORS, 2018, 18 (11)
  • [8] Image quality measures and their performance
    Eskicioglu, AM
    Fisher, PS
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) : 2959 - 2965
  • [9] SEDRFuse: A Symmetric Encoder-Decoder With Residual Block Network for Infrared and Visible Image Fusion
    Jian, Lihua
    Yang, Xiaomin
    Liu, Zheng
    Jeon, Gwanggil
    Gao, Mingliang
    Chisholm, David
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [10] Adaptive fusion method of visible light and infrared images based on non-subsampled shearlet transform and fast non-negative matrix factorization
    Kong, Weiwei
    Lei, Yang
    Zhao, Huaixun
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2014, 67 : 161 - 172