Fidelity-driven Optimization Reconstruction and Details Preserving Guided Fusion for Multi-Modality Medical Image

被引:17
作者
He, Kangjian [1 ]
Zhang, Xuejie [1 ]
Xu, Dan [1 ]
Gong, Jian [1 ]
Xie, Lisiqi [1 ]
机构
[1] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650091, Peoples R China
基金
中国国家自然科学基金;
关键词
Details preserving; image fusion; low-rank approximation; Multi-modality; weighted mean curvature; MULTI-FOCUS IMAGE; COUPLED NEURAL-NETWORK; REPRESENTATION; INFORMATION; PERFORMANCE; MODEL;
D O I
10.1109/TMM.2022.3185887
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
By integrating effective features of multi-modality medical images to provide richer information, multi-modality medical image fusion has been substantially used in computer-aided diagnosis applications. However, many existing fusion schemes do not consider how to eliminate the effects of the noise in source medical images and cannot provide enough details and textures for disease diagnosis. To address the problems above, we propose a new fidelity-driven optimization (FDO) reconstruction and details preserving guided-based fusion method for multi-modality medical images. To overcome the influence of noise in multi-modality medical images, a rank coefficient optimization method of low-rank approximation based on weighted mean curvature is proposed to reconstruct multi-modality medical image. Moreover, we propose an iterative detail preserving guided fusion (DPGF) method to integrate more textures and detail information of source multi-modality medical images, while ensuring high signal-to noise ratios. The experimental results show that the proposed method outperforms some of the state-of-the-art fusion methods. Specifically, the extensive experiments prove that our method has high robustness for noisy medical images, which also indicates the application prospects in diagnosis applications.
引用
收藏
页码:4943 / 4957
页数:15
相关论文
共 56 条
[1]   Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain [J].
Bhatnagar, Gaurav ;
Wu, Q. M. Jonathan ;
Liu, Zheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (05) :1014-1024
[2]   NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency [J].
Das, Sudeb ;
Kundu, Malay Kumar .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2012, 50 (10) :1105-1114
[3]   Saliency Detection via a Multiple Self-Weighted Graph-Based Manifold Ranking [J].
Deng, Cheng ;
Yang, Xu ;
Nie, Feiping ;
Tao, Dapeng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (04) :885-896
[4]   A comparative review: Medical image fusion using SWT and DWT [J].
Diwakar, Manoj ;
Tripathi, Amrendra ;
Joshi, Kapil ;
Sharma, Ayush ;
Singh, Prabhishek ;
Memoria, Minakshi ;
Kumar, Neeraj .
MATERIALS TODAY-PROCEEDINGS, 2021, 37 :3411-3416
[5]   A general memristor-based pulse coupled neural network with variable linking coefficient for multi-focus image fusion [J].
Dong, Zhekang ;
Lai, Chun Sing ;
Qi, Donglian ;
Xu, Zhao ;
Li, Chaoyong ;
Duan, Shukai .
NEUROCOMPUTING, 2018, 308 :172-183
[6]   THE APPROXIMATION OF ONE MATRIX BY ANOTHER OF LOWER RANK [J].
Eckart, Carl ;
Young, Gale .
PSYCHOMETRIKA, 1936, 1 (03) :211-218
[7]   A Survey on Deep Learning for Multimodal Data Fusion [J].
Gao, Jing ;
Li, Peng ;
Chen, Zhikui ;
Zhang, Jianing .
NEURAL COMPUTATION, 2020, 32 (05) :829-864
[8]   Weighted mean curvature [J].
Gong, Yuanhao ;
Goksel, Orcun .
SIGNAL PROCESSING, 2019, 164 :329-339
[9]   An Efficient SVD-Based Method for Image Denoising [J].
Guo, Qiang ;
Zhang, Caiming ;
Zhang, Yunfeng ;
Liu, Hui .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (05) :868-880
[10]   Mutually Guided Image Filtering [J].
Guo, Xiaojie ;
Yu, Li ;
Ma, Jiayi ;
Ling, Haibin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (03) :694-707