Unsupervised Denoising of Optical Coherence Tomography Images With Nonlocal-Generative Adversarial Network

被引:47
作者
Guo, Anjing [1 ,2 ]
Fang, Leyuan [1 ,2 ]
Qi, Min [3 ]
Li, Shutao [1 ,2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] Key Lab Visual Percept & Artificial Intelligence, Changsha 410082, Peoples R China
[3] Cent South Univ, Dept Plast Surg, Xiangya Hosp, Changsha 410082, Peoples R China
关键词
Deep learning; generative adversarial networks (GANs); image denoising; optical coherence tomography (OCT); SPECKLE REDUCTION; NOISE-REDUCTION; SD-OCT; SPARSE; SEGMENTATION; FILTER;
D O I
10.1109/TIM.2020.3017036
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep learning for image denoising has recently attracted considerable attentions due to its excellent performance. Since most of current deep learning-based denoising models require a large number of clean images for training, it is difficult to extend them to the denoising problems when the reference clean images are hard to acquire (e.g., optical coherence tomography (OCT) images). In this article, we propose a novel unsupervised deep learning model called as nonlocal-generative adversarial network (nonlocal-GAN) for OCT image denoising, where the deep model can be trained without reference clean images. Specifically, considering that the background areas of OCT images mainly contain pure real noise samples, we creatively train a discriminator to distinguish background real noise samples from the fake noise samples generated by the denoiser, that is the generator, and then the discriminator will guide the generator for denoising. To further enhance denoising performance, we introduce a nonlocal means layer into the generator of the nonlocal-GAN model. Furthermore, since nearby several OCT B-scans have strong correlations, we also propose a nonlocal-GAN-M model to utilize the high correlations within nearby B-scans. Extensive experimental results on clinical retinal OCT images demonstrate the effectiveness and efficiency of the proposed method.
引用
收藏
页数:12
相关论文
共 51 条
[1]   Three-dimensional optical coherence tomography image denoising through multi-input fully-convolutional networks [J].
Abbasi, Ashkan ;
Monadjemi, Amirhassan ;
Fang, Leyuan ;
Rabbani, Hossein ;
Zhang, Yi .
COMPUTERS IN BIOLOGY AND MEDICINE, 2019, 108 :1-8
[2]  
[Anonymous], 2009, Advances in Neural Information Processing Systems
[3]  
Anwar S., 2019, ARXIV190407396
[4]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[5]   A Technique to Improve the Image Quality in Computer Tomography [J].
Attivissimo, Filippo ;
Cavone, Giuseppe ;
Lanzolla, Anna Maria Lucia ;
Spadavecchia, Maurizio .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2010, 59 (05) :1251-1257
[6]   A review of image denoising algorithms, with a new one [J].
Buades, A ;
Coll, B ;
Morel, JM .
MULTISCALE MODELING & SIMULATION, 2005, 4 (02) :490-530
[7]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[8]  
Burger HC, 2012, PROC CVPR IEEE, P2392, DOI 10.1109/CVPR.2012.6247952
[9]   Image Blind Denoising With Generative Adversarial Network Based Noise Modeling [J].
Chen, Jingwen ;
Chen, Jiawei ;
Chao, Hongyang ;
Yang, Ming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3155-3164
[10]   Speckle Reduction in 3D Optical Coherence Tomography of Retina by A-Scan Reconstruction [J].
Cheng, Jun ;
Tao, Dacheng ;
Quan, Ying ;
Wong, Damon Wing Kee ;
Cheung, Gemmy Chui Ming ;
Akiba, Masahiro ;
Liu, Jiang .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (10) :2270-2279