DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images

被引:36
作者
Cheong, Haris [1 ]
Devalla, Sripad Krishna [1 ]
Tan Hung Pham [1 ]
Zhang, Liang [1 ]
Tin Aung Tun [2 ]
Wang, Xiaofei [3 ]
Perera, Shamira [2 ,4 ]
Schmetterer, Leopold [2 ,4 ,5 ,6 ,7 ]
Tin Aung [1 ,2 ]
Boote, Craig [1 ,8 ,9 ]
Thiery, Alexandre [5 ]
Girard, Michael J. A. [1 ,2 ]
机构
[1] Natl Univ Singapore, Fac Engn, Dept Biomed Engn, Ophthalm Engn & Innovat Lab, 4 Engn Dr 3,Block E4 04-08, Singapore 117583, Singapore
[2] Singapore Natl Eye Ctr, Singapore Eye Res Inst, Singapore, Singapore
[3] Beihang Univ, Beijing Adv Innovat Ctr Biomed Engn, Sch Biol Sci & Med Engn, Beijing, Peoples R China
[4] Duke NUS Med Sch, Ophthalmol Dept, Singapore, Singapore
[5] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
[6] Nanyang Technol Univ, Lee Kong Chian Sch Med, Singapore, Singapore
[7] Med Univ Vienna, Dept Clin Pharmacol, Vienna, Austria
[8] Cardiff Univ, Sch Optometry & Vis Sci, Cardiff, Wales
[9] Newcastle Res & Innovat Inst, Singapore, Singapore
基金
英国医学研究理事会;
关键词
glaucoma; generative adversarial network; deep learning; shadow removal; LAMINA-CRIBROSA; GLAUCOMA; BIOMECHANICS; ENHANCEMENT;
D O I
10.1167/tvst.9.2.23
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Purpose: To remove blood vessel shadows from optical coherence tomography (OCT) images of the optic nerve head (ONH). Methods: Volume scans consisting of 97 horizontal B-scans were acquired through the center of the ON H using a commercial OCT device for both eyes of 13 subjects. A custom generative adversarial network (named DeshadowGAN) was designed and trained with 2328 B-scans in order to remove blood vessel shadows in unseen B-scans. Image quality was assessed qualitatively (for artifacts) and quantitatively using the intralayer contrast-a measure of shadow visibility ranging from 0 (shadow-free) to 1 (strong shadow). This was computed in the retinal nerve fiber layer (RNFL), the inner plexiform layer (IPL), the photoreceptor (PR) layer, and the retinal pigment epithelium (RPE) layer. The performance of DeshadowGAN was also compared with that of compensation, the standard for shadow removal. Results: DeshadowGAN decreased the intralayer contrast in all tissue layers. On average, the intralayer contrast decreased by 33.7 +/- 6.81%, 28.8 +/- 10.4%, 35.9 +/- 13.0%, and 43.0 +/- 19.5% for the RNFL, IPL, PR layer, and RPE layer, respectively, indicating successful shadow removal across all depths. Output images were also free from artifacts commonly observed with compensation. Conclusions: DeshadowGAN significantly corrected blood vessel shadows in OCT images of the ONH. Our algorithm may be considered as a preprocessing step to improve the performance of a wide range of algorithms including those currently being used for OCT segmentation, denoising, and classification. Translational Relevance: DeshadowGAN could be integrated to existing OCT devices to improve the diagnosis and prognosis of ocular pathologies.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 46 条
[1]  
[Anonymous], 2017, ARXIV
[2]   Deformation of the lamina cribrosa and anterior scleral canal wall in early experimental glaucoma [J].
Bellezza, AJ ;
Rintalan, CJ ;
Thompson, HW ;
Downs, JC ;
Hart, RT ;
Burgoyne, CF .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2003, 44 (02) :623-637
[3]   The optic nerve head as a biomechanical structure: a new paradigm for understanding the role of IOP-related stress and strain in the pathophysiology of glaucomatous optic nerve head damage [J].
Burgoyne, CF ;
Downs, JC ;
Bellezza, AJ ;
Suh, JKF ;
Hart, RT .
PROGRESS IN RETINAL AND EYE RESEARCH, 2005, 24 (01) :39-73
[4]   Biomechanics of the Human Posterior Sclera: Age- and Glaucoma-Related Changes Measured Using Inflation Testing [J].
Coudrillier, Baptiste ;
Tian, Jing ;
Alexander, Stephen ;
Myers, Kristin M. ;
Quigley, Harry A. ;
Nguyen, Thao D. .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2012, 53 (04) :1714-1728
[5]   A Deep Learning Approach to Denoise Optical Coherence Tomography Images of the Optic Nerve Head [J].
Devalla, Sripad Krishna ;
Subramanian, Giridhar ;
Tan Hung Pham ;
Wang, Xiaofei ;
Perera, Shamira ;
Tun, Tin A. ;
Aung, Tin ;
Schmetterer, Leopold ;
Thiery, Alexandre H. ;
Girard, Michael J. A. .
SCIENTIFIC REPORTS, 2019, 9 (1)
[6]   Compression Artifacts Reduction by a Deep Convolutional Network [J].
Dong, Chao ;
Deng, Yubin ;
Loy, Chen Change ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :576-584
[7]   Scleral biomechanics and glaucoma - a connection? [J].
Ethier, CR .
CANADIAN JOURNAL OF OPHTHALMOLOGY-JOURNAL CANADIEN D OPHTALMOLOGIE, 2006, 41 (01) :9-11
[8]   Automated retinal shadow compensation of optical coherence tomography images [J].
Fabritius, Tapio ;
Makita, Shuichi ;
Hong, Yongjoo ;
Myllyla, Risto ;
Yasuno, Yoshiaki .
JOURNAL OF BIOMEDICAL OPTICS, 2009, 14 (01)
[9]   U-Net: deep learning for cell counting, detection, and morphometry [J].
Falk, Thorsten ;
Mai, Dominic ;
Bensch, Robert ;
Cicek, Oezguen ;
Abdulkadir, Ahmed ;
Marrakchi, Yassine ;
Boehm, Anton ;
Deubner, Jan ;
Jaeckel, Zoe ;
Seiwald, Katharina ;
Dovzhenko, Alexander ;
Tietz, Olaf ;
Dal Bosco, Cristina ;
Walsh, Sean ;
Saltukoglu, Deniz ;
Tay, Tuan Leng ;
Prinz, Marco ;
Palme, Klaus ;
Simons, Matias ;
Diester, Ilka ;
Brox, Thomas ;
Ronneberger, Olaf .
NATURE METHODS, 2019, 16 (01) :67-+
[10]   Automated 3-D Intraretinal Layer Segmentation of Macular Spectral-Domain Optical Coherence Tomography Images [J].
Garvin, Mona Kathryn ;
Abramoff, Michael David ;
Wu, Xiaodong ;
Russell, Stephen R. ;
Burns, Trudy L. ;
Sonka, Milan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2009, 28 (09) :1436-1447