Segmentation-guided domain adaptation and data harmonization of multi-device retinal optical coherence tomography using cycle-consistent generative adversarial networks

被引:5
作者
Chen, Shuo [1 ]
Ma, Da [1 ,2 ,3 ,4 ]
Lee, Sieun [5 ,6 ]
Yu, Timothy T. L. [1 ]
Xu, Gavin [1 ]
Lu, Donghuan [1 ,7 ]
Popuri, Karteek [1 ,8 ]
Ju, Myeong Jin [9 ,10 ]
Sarunic, Marinko, V [1 ,11 ,12 ]
Beg, Mirza Faisal [1 ]
机构
[1] Simon Fraser Univ, Sch Engn Sci, Burnaby, BC, Canada
[2] Wake Forest Univ, Sch Med, Dept Internal Med, Sect Gerontol & Geriatr Med, Winston Salem, NC 27101 USA
[3] Wake Forest Sch Med, Ctr Biomed Informat, Winston Salem, NC 27101 USA
[4] Wake Forest Sch Med, Alzheimers Dis Res Ctr, Winston Salem, NC 27101 USA
[5] Univ Nottingham, Sch Med, Mental Hlth & Clin Neurosci, Nottingham, England
[6] Univ Nottingham, Precis Imaging Beacon, Nottingham, England
[7] Tencent Jarvis Lab, Shenzhen, Peoples R China
[8] Mem Univ Newfoundland, Dept Comp Sci, St John, NF, Canada
[9] Univ British Columbia, Sch Biomed Engn, Vancouver, BC, Canada
[10] Univ British Columbia, Dept Ophthalmol & Visual Sci, Vancouver, BC, Canada
[11] UCL, Inst Ophthalmol, London, England
[12] UCL, Dept Med Phys & Biomed Engn, London, England
基金
加拿大健康研究院;
关键词
CycleGAN; Domain adaptation; Optical coherence tomography; Retinal segmentation; QUALITY; LAYER;
D O I
10.1016/j.compbiomed.2023.106595
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Background: Medical images such as Optical Coherence Tomography (OCT) images acquired from different devices may show significantly different intensity profiles. An automatic segmentation model trained on images from one device may perform poorly when applied to images acquired using another device, resulting in a lack of generalizability. This study addresses this issue using domain adaptation methods improved by Cycle-Consistent Generative Adversarial Networks (CycleGAN), especially when the ground-truth labels are only available in the source domain.Methods: A two-stage pipeline is proposed to generate segmentation in the target domain. The first stage involves the training of a state-of-the-art segmentation model in the source domain. The second stage aims to adapt the images from the target domain to the source domain. The adapted target domain images are segmented using the model in the first stage. Ablation tests were performed with integration of different loss functions, and the statistical significance of these models is reported. Both the segmentation performance and the adapted image quality metrics were evaluated.Results: Regarding the segmentation Dice score, the proposed model ssppg achieves a significant improvement of 46.24% compared to without adaptation and reaches 87.4% of the upper limit of the segmentation performance. Furthermore, image quality metrics, including FID and KID scores, indicate that adapted images with better segmentation also have better image qualities. Conclusion: The proposed method demonstrates the effectiveness of segmentation-driven domain adaptation in retinal imaging processing. It reduces the labor cost of manual labeling, incorporates prior anatomic information to regulate and guide domain adaptation, and provides insights into improving segmentation qualities in image domains without labels.
引用
收藏
页数:15
相关论文
共 47 条
[1]  
[Anonymous], Rethinking the inception architecture for computer vision
[2]  
Arjovsky M, 2017, Arxiv, DOI arXiv:1701.07875
[3]   Statistics and reduction of speckle in optical coherence tomography [J].
Bashkansky, M ;
Reintjes, J .
OPTICS LETTERS, 2000, 25 (08) :545-547
[4]   Integrating structured biological data by Kernel Maximum Mean Discrepancy [J].
Borgwardt, Karsten M. ;
Gretton, Arthur ;
Rasch, Malte J. ;
Kriegel, Hans-Peter ;
Schoelkopf, Bernhard ;
Smola, Alex J. .
BIOINFORMATICS, 2006, 22 (14) :E49-E57
[5]  
Che T, 2017, Arxiv, DOI arXiv:1702.07983
[6]  
Cong Wenyan, 2019, DOVENET DEEP IMAGE H, P11, DOI [10.48550/arXiv.1911.13239, DOI 10.48550/ARXIV.1911.13239]
[7]   Deep learning-based unlearning of dataset bias for MRI harmonisation and confound removal [J].
Dinsdale, Nicola K. ;
Jenkinson, Mark ;
Namburete, Ana I. L. .
NEUROIMAGE, 2021, 228
[8]  
Dowson D.C., 1982, FRKHET DISTANCE MULT
[9]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[10]  
Gretton A, 2012, J MACH LEARN RES, V13, P723