Medical image fusion based on extended difference-of-Gaussians and edge-preserving

被引:29
作者
Jie, Yuchan [1 ]
Li, Xiaosong [1 ]
Wang, Mingyi [1 ]
Zhou, Fuqiang [2 ]
Tan, Haishu [1 ]
机构
[1] Foshan Univ, Sch Phys & Optoelect Engn, Guangdong Hong Kong Macao Joint Lab Intelligent Mi, Hong Kong 528225, Guangdong, Peoples R China
[2] Beihang Univ, Sch Instrumentat & Optoelect Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image fusion; Extended difference-of-Gaussians; Edge-preserving; Spatial frequency energy; QUALITY ASSESSMENT; INFORMATION; PERFORMANCE; MODEL;
D O I
10.1016/j.eswa.2023.120301
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multimodal medical image fusion extracts useful information from different modal medical images and in-tegrates them into one image for a comprehensive and objective lesion description. However, existing methods ignore the simultaneous retention of significant edge and energy information that reflect lesion characteristics in medical images; this affects the application value of medical image fusion in computer aided diagnosis. This paper proposes a novel medical image fusion scheme based on extended difference-of-Gaussians (XDoG) and edge-preserving. A simple yet effective energy-based scheme was developed to generate the fused energy layer, which helped preserve energy. Moreover, the averaging filter was used to generate the detail layers of source images. The fusion of detail layers was considered the combination of significant and non-significant edge in-formation. A rule of the detail layer with a salient edge based on edge extraction operator XDoG was proposed to efficiently detect the salient structure of the significant edges, and a spatial frequency energy operator was developed to detect the gradient and energy of non-significant information. The fused result could be recon-structed by synthesizing the fused energy layer and details of significant and non-significant edges. Experiments demonstrated that the proposed approach outperforms some advanced fusion methods in terms of subjective and objective assessment. The code of this paper is available at https://github.com/JEI981214/FGF-and-X DoG-based.
引用
收藏
页数:21
相关论文
共 62 条
[1]  
[Anonymous], 2016, P IEEE CVPR
[2]   A new automated quality assessment algorithm for image fusion [J].
Chen, Yin ;
Blum, Rick S. .
IMAGE AND VISION COMPUTING, 2009, 27 (10) :1421-1432
[3]   The nonsubsampled contourlet transform: Theory, design, and applications [J].
da Cunha, Arthur L. ;
Zhou, Jianping ;
Do, Minh N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (10) :3089-3101
[4]   Multi-modality medical image fusion based on guided filter and image statistics in multidirectional shearlet transform domain [J].
Dogra A. ;
Kumar S. .
Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (09) :12191-12205
[5]   Comparison of deep convolutional neural networks and edge detectors for image-based crack detection in concrete [J].
Dorafshan, Sattar ;
Thomas, Robert J. ;
Maguire, Marc .
CONSTRUCTION AND BUILDING MATERIALS, 2018, 186 :1031-1045
[6]   Anatomical-Functional Image Fusion by Information of Interest in Local Laplacian Filtering Domain [J].
Du, Jiao ;
Li, Weisheng ;
Xiao, Bin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (12) :5855-5866
[7]   Image quality measures and their performance [J].
Eskicioglu, AM ;
Fisher, PS .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1995, 43 (12) :2959-2965
[8]   A novel circulating miRNA panel for non-invasive ovarian cancer diagnosis and prognosis [J].
Gahlawat, Aoife Ward ;
Witte, Tania ;
Haarhuis, Lisa ;
Schott, Sarah .
BRITISH JOURNAL OF CANCER, 2022, 127 (08) :1550-1556
[9]   Feasibility study of a multi-criteria decision-making based hierarchical model for multi-modality feature and multi-classifier fusion: Applications in medical prognosis prediction [J].
He, Qiang ;
Li, Xin ;
Kim, D. W. Nathan ;
Jia, Xun ;
Gu, Xuejun ;
Zhen, Xin ;
Zhou, Linghong .
INFORMATION FUSION, 2020, 55 :207-219
[10]   Multimodal medical image fusion review: Theoretical background and recent advances [J].
Hermessi, Haithem ;
Mourali, Olfa ;
Zagrouba, Ezzeddine .
SIGNAL PROCESSING, 2021, 183