Multi-Modal Image Fusion via a Novel Multi-scale Edge-preserving Decomposition

被引:0
|
作者
Rong, Chuanzhen [1 ]
Jia, Yongxing [1 ]
Yang, Yu [1 ]
Zhu, Ying [1 ]
Wang, Yuan [1 ]
Ni, Xue [1 ]
机构
[1] Army Engn Univ PLA, Commun Engn Coll, Nanjing, Jiangsu, Peoples R China
关键词
guided filter; Gaussian filter; image fusion; image evaluation; multi-scale decomposition; edge-preserving decomposition; PERFORMANCE;
D O I
10.1109/wcsp.2019.8927992
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
For the traditional MSD-based infrared and visible image fusion methods, the fused images often have low contrast, and the textural details are not well preserved. This paper proposed a novel multi-scale edge-preserving decomposition method based on the guided and Gaussian filters. The small scale texture detail information and the large-scale edge information, which represented the visible feature component and the infrared feature component, respectively, can be extracted by the proposed method. In order to effectively inject the infrared information into the visible image, the large-scale edge layer is used to construct the fused weights. Experimental results show that the proposed method can not only highlight the infrared object, but also preserve the textural details as much as possible, which is superior to the existing MSD-based fusion methods both in the subjective evaluation and objective assessment. The proposed fusion method is also applicable to medical image fusion and has obtained state-of-the-art performance.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] Multi-modal Remote Sensing Image Registration Based on Multi-scale Phase Congruency
    Cui, Song
    Zhong, Yanfei
    2018 10TH IAPR WORKSHOP ON PATTERN RECOGNITION IN REMOTE SENSING (PRRS), 2018,
  • [42] Edge-Preserving Smoothing for Image Decomposition via a Hybrid Approach
    Wang, Yang
    Liu, Hongzhi
    Wu, Zhonghai
    FIFTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2013), 2014, 9069
  • [43] Multi-scale multi-modal fusion for object detection in autonomous driving based on selective kernel
    Gao, Xin
    Zhang, Guoying
    Xiong, Yijin
    MEASUREMENT, 2022, 194
  • [44] A Multi-scale and Multi-modal Transportation GIS for the City of Guangzhou
    Chen, Shaopei
    Claramunt, Christophe
    Ray, Cyril
    Tan, Jianjun
    INFORMATION FUSION AND GEOGRAPHIC INFORMATION SYSTEMS, PROCEEDINGS, 2009, : 95 - 111
  • [45] MMTFN: Multi-modal multi-scale transformer fusion network for Alzheimer's disease diagnosis
    Miao, Shang
    Xu, Qun
    Li, Weimin
    Yang, Chao
    Sheng, Bin
    Liu, Fangyu
    Bezabih, Tsigabu T.
    Yu, Xiao
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2024, 34 (01)
  • [46] Multi-modal neural networks with multi-scale RGB-T fusion for semantic segmentation
    Lyu, Y.
    Schiopu, I.
    Munteanu, A.
    ELECTRONICS LETTERS, 2020, 56 (18) : 920 - 922
  • [47] Multi-Scale Fusion and Decomposition Network for Single Image Deraining
    Wang, Qiong
    Jiang, Kui
    Wang, Zheng
    Ren, Wenqi
    Zhang, Jianhui
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 191 - 204
  • [48] Single Image Snow Removal via Multi-Scale Dual Domain Decomposition and Fusion
    Zhang, Yunpeng
    Zhou, Pucheng
    Xue, Mogen
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [49] Multi-modal Image Fusion with KNN Matting
    Zhang, Xia
    Lin, Hui
    Kang, Xudong
    Li, Shutao
    PATTERN RECOGNITION (CCPR 2014), PT II, 2014, 484 : 89 - 96
  • [50] CEFusion: Multi-Modal medical image fusion via cross encoder
    Zhu, Ya
    Wang, Xue
    Chen, Luping
    Nie, Rencan
    IET Image Processing, 2023, 16 (12) : 3177 - 3189