Data augmentation for patch-based OCT chorio-retinal segmentation using generative adversarial networks

被引:18
作者
Kugelman, Jason [1 ]
Alonso-Caneiro, David [1 ,2 ]
Read, Scott A. [1 ]
Vincent, Stephen J. [1 ]
Chen, Fred K. [2 ,3 ]
Collins, Michael J. [1 ]
机构
[1] Queensland Univ Technol QUT, Ctr Vis & Eye Res, Sch Optometry & Vis Sci, Contact Lens & Visual Opt Lab, Kelvin Grove, Qld 4059, Australia
[2] Univ Western Australia, Incorporating Lions Eye Inst, Ctr Ophthalmol & Visual Sci, Perth, WA, Australia
[3] Royal Perth Hosp, Dept Ophthalmol, Perth, WA, Australia
基金
英国医学研究理事会;
关键词
Neural networks; Deep learning; Optical coherence tomography; Generative adversarial networks; Image segmentation; Data augmentation; COHERENCE TOMOGRAPHY IMAGES; AUTOMATIC SEGMENTATION; CHOROIDAL THICKNESS; LAYER; BOUNDARIES;
D O I
10.1007/s00521-021-05826-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many clinical and research tasks rely critically upon the segmentation of tissue layers in optical coherence tomography (OCT) images of the posterior eye (the retina and choroid). However, a major limitation of using machine learning-based segmentation methods is that performance depends on a large quantity of and diversity in the data used to train the models. Due to their demonstrated ability to generate high quality and diverse synthetic images, we propose the application of GANs here to augment data for a patch-based approach to OCT chorio-retinal boundary segmentation. Given the complexity of GAN training, a range of experiments are performed to understand and optimise performance. We show that it is feasible to generate patches that are visually indistinguishable from their real variants and in the best case, the segmentation performance utilising solely synthetic data is nearly comparable to a model trained on real data. The data augmentation capabilities are demonstrated with classification performance improvements realised on a range of sparse datasets. These findings highlight the potential use of GANs for data augmentation in future work with chorio-retinal OCT images. Additionally, this study includes a range of experimental findings and an analysis of techniques which may be useful for developing or improving GAN-based methods that are not necessarily limited to chorio-retinal images, the OCT modality, or data augmentation.
引用
收藏
页码:7393 / 7408
页数:16
相关论文
共 49 条
[1]  
[Anonymous], 2018, COMPUTER VISION ACCV
[2]  
[Anonymous], 2015, ARXIV151205287
[3]  
[Anonymous], 2018, ARXIV180301229
[4]  
[Anonymous], 2016, ARXIV170107875
[5]   Red blood cell image generation for data augmentation using Conditional Generative Adversarial Networks [J].
Bailo, Oleksandr ;
Ham, DongShik ;
Shin, Young Min .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :1039-1048
[6]   Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema [J].
Chiu, Stephanie J. ;
Allingham, Michael J. ;
Mettu, Priyatham S. ;
Cousins, Scott W. ;
Izatt, Joseph A. ;
Farsiu, Sina .
BIOMEDICAL OPTICS EXPRESS, 2015, 6 (04) :1172-1194
[7]   Automatic segmentation of seven retinal layers in SDOCT images congruent with expert manual segmentation [J].
Chiu, Stephanie J. ;
Li, Xiao T. ;
Nicholas, Peter ;
Toth, Cynthia A. ;
Izatt, Joseph A. ;
Farsiu, Sina .
OPTICS EXPRESS, 2010, 18 (18) :19413-19428
[8]  
Dijkstra EW., 1959, NUMER MATH, V1, P269, DOI DOI 10.1007/BF01386390
[9]   Mapping Choroidal and Retinal Thickness Variation in Type 2 Diabetes using Three-Dimensional 1060-nm Optical Coherence Tomography [J].
Esmaeelpour, Marieh ;
Povazay, Boris ;
Hermann, Boris ;
Hofer, Bernd ;
Kajic, Vedran ;
Hale, Sarah L. ;
North, Rachel V. ;
Drexler, Wolfgang ;
Sheen, Nik J. L. .
INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2011, 52 (08) :5311-5316
[10]   Automatic segmentation of nine retinal layer boundaries in OCT images of non-exudative AMD patients using deep learning and graph search [J].
Fang, Leyuan ;
Cunefare, David ;
Wang, Chong ;
Guymer, Robyn H. ;
Li, Shutao ;
Farsiu, Sina .
BIOMEDICAL OPTICS EXPRESS, 2017, 8 (05) :2732-2744