FundusGAN: Fundus image synthesis based on semi-supervised learning

被引:5
作者
Ahn, Sangil [1 ]
Song, Su Jeong [2 ,3 ]
Shin, Jitae [1 ]
机构
[1] Sungkyunkwan Univ, Dept Elect & Comp Engn, Suwon 16419, South Korea
[2] Sungkyunkwan Univ, Kangbuk Samsung Hosp, Dept Ophthalmol, Sch Med, Seoul 03181, South Korea
[3] Sungkyunkwan Univ, Biomed Inst Convergence BICS, Suwon 16419, South Korea
关键词
Diabetic retinopathy; Age-related macular degeneration; Fundus disease; GAN; Image generation; GENERATIVE ADVERSARIAL NETWORKS;
D O I
10.1016/j.bspc.2023.105289
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Our goal is to construct a high-performance model that generates two types of fundus disease images for both Diabetic Retinopathy (DR) and Age-Related Macular degeneration (AMD) that have different symptoms for each severity for overcoming the lack of labeled data and data imbalance problems that hinder to build a model based on deep learning. To this end, we propose a framework named FundusGAN for building fundus image generators in semi-supervised learning. First, a semantic coarse lesion mask as a guidance mask is exploited to express disease and severity information more accurately to generate a final fundus image by adopting a coarse-to-fine strategy. Second, the disease-feature matching loss is proposed to learn the abundant features of the two diseases by employing the unlabeled datasets and is able to generate the initial symptoms of two fundus diseases accurately. We demonstrate the effectiveness of the proposed FundusGAN in comparison with carefully tuned baselines and state-of-the-art DR fundus image generation model and finally achieve 0.9174, and 0.8254 f1-score for DR and AMD, respectively.
引用
收藏
页数:12
相关论文
共 47 条
[1]   BrainGAN: Brain MRI Image Generation and Classification Framework Using GAN Architectures and CNN Models [J].
Alrashedy, Halima Hamid N. ;
Almansour, Atheer Fahad ;
Ibrahim, Dina M. ;
Hammoudeh, Mohammad Ali A. .
SENSORS, 2022, 22 (11)
[2]   Diabetic Retinopathy Fundus Image Classification and Lesions Localization System Using Deep Learning [J].
Alyoubi, Wejdan L. ;
Abulkhair, Maysoon F. ;
Shalash, Wafaa M. .
SENSORS, 2021, 21 (11)
[3]  
Asia Pacific Tele-Ophthalmology Society, 2015, APT 2019 BLINDN DET
[4]  
California Healthcare Foundation EyePACS., 2015, DIABETIC RETINOPATHY
[5]   Deepfakes in Ophthalmology Applications and Realism of Synthetic Retinal Images from Generative Adversarial Networks [J].
Chen, Jimmy S. ;
Coyner, Aaron S. ;
Chan, R. V. Paul ;
Hartnett, M. Elizabeth ;
Moshfeghi, Darius M. ;
Owen, Leah A. ;
Kalpathy-Cramer, Jayashree ;
Chiang, Michael F. ;
Campbell, J. Peter .
OPHTHALMOLOGY SCIENCE, 2021, 1 (04)
[6]   Attentional coarse -and -fine generative adversarial networks for image inpainting [J].
Chen, Minyu ;
Liu, Zhi ;
Ye, Linwei ;
Wang, Yang .
NEUROCOMPUTING, 2020, 405 :259-269
[7]   RF-GANs: A Method to Synthesize Retinal Fundus Images Based on Generative Adversarial Network [J].
Chen, Yu ;
Long, Jun ;
Guo, Jifeng .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2021, 2021
[8]   Synthesis of 3D MRI Brain Images With Shape and Texture Generative Adversarial Deep Neural Networks [J].
Chong, Chee Keong ;
Ho, Eric Tatt Wei .
IEEE ACCESS, 2021, 9 :64747-64760
[9]   Applying Self-Supervised Learning to Medicine: Review of the State of the Art and Medical Implementations [J].
Chowdhury, Alexander ;
Rosenthal, Jacob ;
Waring, Jonathan ;
Umeton, Renato .
INFORMATICS-BASEL, 2021, 8 (03)
[10]   CNNs for automatic glaucoma assessment using fundus images: an extensive validation [J].
Diaz-Pinto, Andres ;
Morales, Sandra ;
Naranjo, Valery ;
Koehler, Thomas ;
Mossi, Jose M. ;
Navea, Amparo .
BIOMEDICAL ENGINEERING ONLINE, 2019, 18 (1)