FCFusion: Fractal Componentwise Modeling With Group Sparsity for Medical Image Fusion

被引:18
作者
Xu, Guoxia [1 ]
Deng, Xiaoxue [2 ]
Zhou, Xiaokang [3 ,4 ]
Pedersen, Marius [1 ]
Cimmino, Lucia [5 ]
Wang, Hao [1 ]
机构
[1] Norwegian Univ Sci & Technol, Dept Comp Sci, N-2815 Gjovik, Norway
[2] Nanjing Univ Posts & Telecommun, Jiangsu Prov Key Lab Image Proc & Image Commun, Nanjing 210003, Peoples R China
[3] Shiga Univ, Fac Data Sci, Hikone 5228522, Japan
[4] RIKEN, RIKEN Ctr Adv Intelligence Project, Tokyo 1030027, Japan
[5] Univ Salerno, Dept Comp Sci, I-84084 Fisciano, Italy
关键词
Image fusion; Feature extraction; Fractals; Redundancy; Medical diagnostic imaging; Biometrics (access control); Sparse matrices; Alternating direction method of multipliers (ADMM) algorithm; fractal componentwise; group sparsity; medical image fusion; structural patch prior; FRAMEWORK; FINGERPRINT;
D O I
10.1109/TII.2022.3185050
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multimodal image fusion is the process of combing relevant biological information that can be used for automated industrial application. In this article, we present a novel framework combining fractal constraint with group sparsity to achieve the optimal fusion quality. First, we adopt the idea of patch division and componentwise separation to perceive the fractal characteristics across multimodality sources. Then, to preserve the spatial information against the redundancy of component-entanglement, the group sparsity is proposed. A dual variable weighting rule is inherently embedded to mitigate the overfitting across the component penalty. Furthermore, the alternating direction method of multipliers is conducted to the proposed model optimization. The experiments show that our model has a better performance in quantitative visual quality and qualitative evaluation analysis. Finally, a real segmentation application of positron emission tomography/computed tomography image fusion proves the effectiveness of our algorithm.
引用
收藏
页码:9141 / 9150
页数:10
相关论文
共 41 条
[1]   Biometric-based efficient medical image watermarking in E-healthcare application [J].
Aparna, Puvvadi ;
Kishore, Polurie Venkata Vijay .
IET IMAGE PROCESSING, 2019, 13 (03) :421-428
[2]   Joint segmentation of anatomical and functional images: Applications in quantification of lesions from PET, PET-CT, MRI-PET, and MRI-PET-CT images [J].
Bagci, Ulas ;
Udupa, Jayaram K. ;
Mendhiratta, Neil ;
Foster, Brent ;
Xu, Ziyue ;
Yao, Jianhua ;
Chen, Xinjian ;
Mollura, Daniel J. .
MEDICAL IMAGE ANALYSIS, 2013, 17 (08) :929-945
[3]   Thermal Multisensor Fusion for Collaborative Robotics [J].
Benli, Emrah ;
Spidalieri, Richard Lee ;
Motai, Yuichi .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (07) :3784-3795
[4]   Directive Contrast Based Multimodal Medical Image Fusion in NSCT Domain [J].
Bhatnagar, Gaurav ;
Wu, Q. M. Jonathan ;
Liu, Zheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (05) :1014-1024
[5]  
Chen Y, 2019, INT GEOSCI REMOTE SE, P234, DOI [10.1109/igarss.2019.8897967, 10.1109/IGARSS.2019.8897967]
[6]   Attention-Based Multimodal Image Feature Fusion Module for Transmission Line Detection [J].
Choi, Hyeyeon ;
Yun, Jong Pil ;
Kim, Bum Jun ;
Jang, Hyeonah ;
Kim, Sang Woo .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (11) :7686-7695
[7]  
Daneshzand M, 2014, 2014 ZONE 1 CONFERENCE OF THE AMERICAN SOCIETY FOR ENGINEERING EDUCATION (ASEE ZONE 1)
[8]   A Neuro-Fuzzy Approach for Medical Image Fusion [J].
Das, Sudeb ;
Kundu, Malay Kumar .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (12) :3347-3353
[9]   Exploiting Non-Local Priors via Self-Convolution for Highly-Efficient Image Restoration [J].
Guo, Lanqing ;
Zha, Zhiyuan ;
Ravishankar, Saiprasad ;
Wen, Bihan .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1311-1324
[10]   UPDATING THE INVERSE OF A MATRIX [J].
HAGER, WW .
SIAM REVIEW, 1989, 31 (02) :221-239