DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images

被引:36
作者
Cheong, Haris [1 ]
Devalla, Sripad Krishna [1 ]
Tan Hung Pham [1 ]
Zhang, Liang [1 ]
Tin Aung Tun [2 ]
Wang, Xiaofei [3 ]
Perera, Shamira [2 ,4 ]
Schmetterer, Leopold [2 ,4 ,5 ,6 ,7 ]
Tin Aung [1 ,2 ]
Boote, Craig [1 ,8 ,9 ]
Thiery, Alexandre [5 ]
Girard, Michael J. A. [1 ,2 ]
机构
[1] Natl Univ Singapore, Fac Engn, Dept Biomed Engn, Ophthalm Engn & Innovat Lab, 4 Engn Dr 3,Block E4 04-08, Singapore 117583, Singapore
[2] Singapore Natl Eye Ctr, Singapore Eye Res Inst, Singapore, Singapore
[3] Beihang Univ, Beijing Adv Innovat Ctr Biomed Engn, Sch Biol Sci & Med Engn, Beijing, Peoples R China
[4] Duke NUS Med Sch, Ophthalmol Dept, Singapore, Singapore
[5] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
[6] Nanyang Technol Univ, Lee Kong Chian Sch Med, Singapore, Singapore
[7] Med Univ Vienna, Dept Clin Pharmacol, Vienna, Austria
[8] Cardiff Univ, Sch Optometry & Vis Sci, Cardiff, Wales
[9] Newcastle Res & Innovat Inst, Singapore, Singapore
基金
英国医学研究理事会;
关键词
glaucoma; generative adversarial network; deep learning; shadow removal; LAMINA-CRIBROSA; GLAUCOMA; BIOMECHANICS; ENHANCEMENT;
D O I
10.1167/tvst.9.2.23
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Purpose: To remove blood vessel shadows from optical coherence tomography (OCT) images of the optic nerve head (ONH). Methods: Volume scans consisting of 97 horizontal B-scans were acquired through the center of the ON H using a commercial OCT device for both eyes of 13 subjects. A custom generative adversarial network (named DeshadowGAN) was designed and trained with 2328 B-scans in order to remove blood vessel shadows in unseen B-scans. Image quality was assessed qualitatively (for artifacts) and quantitatively using the intralayer contrast-a measure of shadow visibility ranging from 0 (shadow-free) to 1 (strong shadow). This was computed in the retinal nerve fiber layer (RNFL), the inner plexiform layer (IPL), the photoreceptor (PR) layer, and the retinal pigment epithelium (RPE) layer. The performance of DeshadowGAN was also compared with that of compensation, the standard for shadow removal. Results: DeshadowGAN decreased the intralayer contrast in all tissue layers. On average, the intralayer contrast decreased by 33.7 +/- 6.81%, 28.8 +/- 10.4%, 35.9 +/- 13.0%, and 43.0 +/- 19.5% for the RNFL, IPL, PR layer, and RPE layer, respectively, indicating successful shadow removal across all depths. Output images were also free from artifacts commonly observed with compensation. Conclusions: DeshadowGAN significantly corrected blood vessel shadows in OCT images of the ONH. Our algorithm may be considered as a preprocessing step to improve the performance of a wide range of algorithms including those currently being used for OCT segmentation, denoising, and classification. Translational Relevance: DeshadowGAN could be integrated to existing OCT devices to improve the diagnosis and prognosis of ocular pathologies.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 46 条
[11]   ARTIFACTS IN AUTOMATIC RETINAL SEGMENTATION USING DIFFERENT OPTICAL COHERENCE TOMOGRAPHY INSTRUMENTS [J].
Giani, Andrea ;
Cigada, Mario ;
Esmaili, Daniel D. ;
Salvetti, Paola ;
Luccarelli, Saverio ;
Marziani, Ermengarda ;
Luiselli, Cristiano ;
Sabella, Pierfilippo ;
Cereda, Matteo ;
Eandi, Chiara ;
Staurenghi, Giovanni .
RETINA-THE JOURNAL OF RETINAL AND VITREOUS DISEASES, 2010, 30 (04) :607-616
[12]   Enhancement of Corneal Visibility in Optical Coherence Tomography Images Using Corneal Adaptive Compensation [J].
Girard, Michael J. A. ;
Ang, Marcus ;
Chung, Cheuk Wang ;
Farook, Mohamed ;
Strouthidis, Nick ;
Mehta, Jod S. ;
Mari, Jean Martial .
TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2015, 4 (03) :1-11
[13]   Shadow Removal and Contrast Enhancement in Optical Coherence Tomography Images of the Human Optic Nerve Head [J].
Girard, Michael J. A. ;
Strouthidis, Nicholas G. ;
Ethier, C. Ross ;
Mari, Jean Martial .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2011, 52 (10) :7738-7748
[14]  
Gjesteby L, 2017, MED IMAGING 2017 PHY, P1
[15]  
Glorot X., 2010, P 13 INT C ART INT S, P249, DOI DOI 10.1109/LGRS.2016.2565705
[16]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[17]   Ultrahigh-resolution optical coherence tomography using continuum generation in an air-silica microstructure optical fiber [J].
Hartl, I ;
Li, XD ;
Chudoba, C ;
Ghanta, RK ;
Ko, TH ;
Fujimoto, JG ;
Ranka, JK ;
Windeler, RS .
OPTICS LETTERS, 2001, 26 (09) :608-610
[18]  
Hyeongwoo Kim, 2018, ACM Transactions on Graphics, V37, DOI [10.1145/3197517.3201283, 10.18022/acfco.2018.37.1.001]
[19]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[20]   Anatomic relationship between lamina cribrosa, intraocular space, and cerebrospinal fluid space [J].
Jonas, JB ;
Berenshtein, E ;
Holbach, L .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2003, 44 (12) :5189-5195