Two-Stage Deep Denoising With Self-Guided Noise Attention for Multimodal Medical Images

被引:2
作者
Sharif, S. M. A. [1 ]
Naqvi, Rizwan Ali [2 ]
Loh, Woong-Kee [3 ]
机构
[1] Opt AI Inc LG Sciencepk, Dept Res & Dev, Seoul 07793, South Korea
[2] Sejong Univ, Dept Artificial Intelligence & Robot, Seoul 05006, South Korea
[3] Gachon Univ, Sch Comp, Seongnam 1342, South Korea
基金
新加坡国家研究基金会;
关键词
Biomedical imaging; Noise reduction; Noise measurement; Image denoising; Speckle; Gaussian noise; Visualization; Deep learning; medical image denoising; multimodal image; noise attention; two-stage network; SPARSE;
D O I
10.1109/TRPMS.2024.3380090
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Medical image denoising is considered among the most challenging vision tasks. Despite the real-world implications, existing denoising methods have notable drawbacks as they often generate visual artifacts when applied to heterogeneous medical images. This study addresses the limitation of the contemporary denoising methods with an artificial intelligence (AI)-driven two-stage learning strategy. The proposed method learns to estimate the residual noise from the noisy images. Later, it incorporates a novel noise attention mechanism to correlate estimated residual noise with noisy inputs to perform denoising in a course-to-refine manner. This study also proposes to leverage a multimodal learning strategy to generalize the denoising among medical image modalities and multiple noise patterns for widespread applications. The practicability of the proposed method has been evaluated with dense experiments. The experimental results demonstrated that the proposed method achieved state-of-the-art performance by significantly outperforming the existing medical image denoising methods in quantitative and qualitative comparisons. Overall, it illustrates a performance gain of 7.64 in peak signal-to-noise ratio (PSNR), 0.1021 in structural similarity index (SSIM), 0.80 in DeltaE (Delta E) , 0.1855 in visual information fidelity pixelwise (VIFP), and 18.54 in mean squared error (MSE) metrics.
引用
收藏
页码:521 / 531
页数:11
相关论文
共 50 条
[41]   Two-Stage Deep Learning Model for Diagnosis of Lumbar Spondylolisthesis Based on Lateral X-Ray Images [J].
Xu, Chunyang ;
Liu, Xingyu ;
Bao, Beixi ;
Liu, Chang ;
Li, Runchao ;
Yang, Tianci ;
Wu, Yukan ;
Zhang, Yiling ;
Tang, Jiaguang .
WORLD NEUROSURGERY, 2024, 186 :E652-E661
[42]   Two-Stage Deep Learning Method for Breast Cancer Detection Using High-Resolution Mammogram Images [J].
Ibrokhimov, Bunyodbek ;
Kang, Justin-Youngwook .
APPLIED SCIENCES-BASEL, 2022, 12 (09)
[43]   A DEEP ARCHITECTURE BASED ON A TWO-STAGE LEARNING FOR SEMANTIC SEGMENTATION OF LARGE-SIZE REMOTE SENSING IMAGES [J].
Ding, Lei ;
Bruzzone, Lorenzo .
2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, :5228-5231
[44]   TSDLPP: A Novel Two-Stage Deep Learning Framework For Prognosis Prediction Based on Whole Slide Histopathological Images [J].
Liu, Yu ;
Li, Ao ;
Liu, Jiangshu ;
Meng, Gang ;
Wang, Minghui .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2022, 19 (04) :2523-2532
[45]   Two-stage framework for optic disc localization and glaucoma classification in retinal fundus images using deep learning [J].
Muhammad Naseer Bajwa ;
Muhammad Imran Malik ;
Shoaib Ahmed Siddiqui ;
Andreas Dengel ;
Faisal Shafait ;
Wolfgang Neumeier ;
Sheraz Ahmed .
BMC Medical Informatics and Decision Making, 19
[46]   Automatic craniomaxillofacial landmarks detection in CT images of individuals with dentomaxillofacial deformities by a two-stage deep learning model [J].
Tao, Leran ;
Li, Meng ;
Zhang, Xu ;
Cheng, Mengjia ;
Yang, Yang ;
Fu, Yijiao ;
Zhang, Rongbin ;
Qian, Dahong ;
Yu, Hongbo .
BMC ORAL HEALTH, 2023, 23 (01)
[47]   Two-stage framework for optic disc localization and glaucoma classification in retinal fundus images using deep learning [J].
Bajwa, Muhammad Naseer ;
Malik, Muhammad Imran ;
Siddiqui, Shoaib Ahmed ;
Dengel, Andreas ;
Shafait, Faisal ;
Neumeier, Wolfgang ;
Ahmed, Sheraz .
BMC MEDICAL INFORMATICS AND DECISION MAKING, 2019, 19 (1)
[48]   Two-Stage Approach for Semantic Image Segmentation of Breast Cancer : Deep Learning and Mass Detection in Mammographic images [J].
Touazi, Faycal ;
Gaceb, Djamel ;
Chirane, Marouane ;
Herzallah, Selma .
6TH INTERNATIONAL CONFERENCE ON INFORMATICS & DATA-DRIVEN MEDICINE, IDDM 2023, 2023, 3609
[49]   Applying a novel two-stage deep-learning model to improve accuracy in detecting retinal fundus images [J].
Maryada, Sai Kiran Reddy ;
Booker, William Lee ;
Danala, Gopichandh ;
Ha, Catherine An ;
Mudduluru, Sanjana ;
Hougen, Dean F. ;
Zheng, Bin .
MEDICAL IMAGING 2022: COMPUTER-AIDED DIAGNOSIS, 2022, 12033
[50]   A novel two-stage deep learning-based small-object detection using hyperspectral images [J].
Yan, Lu ;
Yamaguchi, Masahiro ;
Noro, Naoki ;
Takara, Yohei ;
Ando, Fuminori .
OPTICAL REVIEW, 2019, 26 (06) :597-606