Generating Synthesized Fluorescein Angiography Images From Color Fundus Images by Generative Adversarial Networks for Macular Edema Assessment

被引:2
作者
Xie, Xiaoling [1 ,2 ]
Jiachu, Danba [3 ]
Liu, Chang [5 ]
Xie, Meng [4 ]
Guo, Jinming [1 ,2 ]
Cai, Kebo [4 ]
Li, Xiangbo [4 ]
Mi, Wei [4 ]
Ye, Hehua [4 ]
Luo, Li [1 ,2 ]
Yang, Jianlong [5 ]
Zhang, Mingzhi [1 ,2 ]
Zheng, Ce [4 ]
机构
[1] Shantou Univ, Joint Shantou Int Eye Ctr, Shantou 515041, Guangdong, Peoples R China
[2] Shantou Univ, Chinese Univ Hong Kong, Med Coll, Shantou 515041, Guangdong, Peoples R China
[3] Kandze Prefecture Peoples Hosp, Kham Eye Ctr, Kangding, Peoples R China
[4] Shanghai Jiao Tong Univ, Xinhua Hosp, Sch Med, Dept Ophthalmol, Shanghai 200092, Peoples R China
[5] Shanghai Jiao Tong Univ, Sch Biomed Engn, 3 Teaching Bldg,1954 Huashan RD, Shanghai 200000, Peoples R China
来源
TRANSLATIONAL VISION SCIENCE & TECHNOLOGY | 2024年 / 13卷 / 09期
关键词
generative adversarial networks; deep learning; fluorescein angiography; color fundus; macular edema; RETINAL VEIN OCCLUSION;
D O I
10.1167/tvst.13.9.26
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Purpose: To assess the feasibility of generating synthetic fluorescein angiography (FA) images from color fundus (CF) images using pixel-to-pixel generative adversarial network (pix2pixGANs) for clinical applications. Research questions addressed image realism to retinal specialists and utility for assessing macular edema (ME) in Retinal Vein Occlusion (RVO) eyes. Methods: We used a registration-guided pix2pixGANs method trained on the CF-FA dataset from Kham Eye Centre, Kandze Prefecture People's Hospital. A visual Turing test confirmed the realism of synthetic images without novel artifacts. We then assessed the synthetic FA images for assessing ME. Finally, we quantitatively evaluated the synthetic images using Fr & eacute;chet Inception distance (FID) and structural similarity measures (SSIM). Results: The raw development dataset had 881 image pairs from 349 subjects. Our approach is capable of generating realistic FA images because small vessels are clearly visible and sharp within one optic disc diameter around the macula. Two retinal specialists agreed that more than 85% of synthetic FA images have good or excellent image quality. For ME detection, accuracy was similar for real and synthetic images. FID demonstrated a 38.9% improvement over the previous state-of-the-art (SOTA), and SSIM reached 0.78 compared to the previous SOTA's 0.67. Conclusions: We developed a pix2pixGANs model translating FA images from label-free CF images, yielding reliable synthetic FA images. This suggests potential for noninvasive evaluation of ME in RVO eyes using pix2pix GANs techniques. Translational Relevance: Pix2pixGANs techniques have the potential to assist in the noninvasive clinical assessment of ME in RVO eyes.
引用
收藏
页数:12
相关论文
共 38 条
[11]   Systemic diseases associated with various types of retinal vein occlusion [J].
Hayreh, SS ;
Zimmerman, B ;
McCarthy, MJ ;
Podhajsky, P .
AMERICAN JOURNAL OF OPHTHALMOLOGY, 2001, 131 (01) :61-77
[12]  
Heusel M, 2017, ADV NEUR IN, V30
[13]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[14]   Blindness and eye disease in a Tibetan region of China: findings from a Rapid Assessment of Avoidable Blindness survey [J].
Jiachu, Danba ;
Jiang, Feng ;
Luo, Li ;
Zheng, Hong ;
Duo, Ji ;
Yang, Jing ;
Nima, Yongcuo ;
Ling, Jin ;
Xiao, Baixiang ;
Bassett, Ken .
BMJ OPEN OPHTHALMOLOGY, 2018, 3 (01)
[15]   Ischemic retinal vein occlusion: characterizing the more severe spectrum of retinal vein occlusion [J].
Khayat, Meiaad ;
Williams, Michael ;
Lois, Noemi .
SURVEY OF OPHTHALMOLOGY, 2018, 63 (06) :816-850
[16]  
KWITEROVICH KA, 1991, OPHTHALMOLOGY, V98, P1139
[17]   Magnetic resonance image (MRI) synthesis from brain computed tomography (CT) images based on deep learning methods for magnetic resonance (MR)-guided radiotherapy [J].
Li, Wen ;
Li, Yafen ;
Qin, Wenjian ;
Liang, Xiaokun ;
Xu, Jianyang ;
Xiong, Jing ;
Xie, Yaoqin .
QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2020, 10 (06) :1223-1236
[18]  
Lira Rodrigo Pessoa Cavalcanti, 2007, Arq. Bras. Oftalmol., V70, P615, DOI 10.1590/S0004-27492007000400011
[19]   Can fluorescein angiography be predicted from color fundus? The effect of a larger training set [J].
Liu, Chang ;
Yang, Jianlong ;
Ye, Hongfei ;
Zhang, Haoran ;
Zheng, Ce ;
Zhang, Aili .
OPHTHALMIC TECHNOLOGIES XXXIII, 2023, 12360
[20]  
Mackay Devin D, 2016, Pract Neurol, V16, P343, DOI 10.1136/practneurol-2016-001443