Digital ray: enhancing cataractous fundus images using style transfer generative adversarial networks to improve retinopathy detection

被引：4

作者：

Liu, Lixue ^{[1
]}

Hong, Jiaming ^{[2
]}

Wu, Yuxuan ^{[1
]}

Liu, Shaopeng ^{[3
]}

Wang, Kai ^{[3
]}

Li, Mingyuan ^{[1
]}

Zhao, Lanqin ^{[1
]}

Liu, Zhenzhen ^{[1
]}

Li, Longhui ^{[1
]}

Cui, Tingxin ^{[1
]}

Tsui, Ching-Kit ^{[1
]}

Xu, Fabao ^{[4
]}

Hu, Weiling ^{[1
]}

Yun, Dongyuan ^{[1
]}

Chen, Xi ^{[1
]}

Shang, Yuanjun ^{[1
]}

Bi, Shaowei ^{[1
]}

Wei, Xiaoyue ^{[1
]}

Lai, Yunxi ^{[1
]}

Lin, Duoru ^{[1
]}

Fu, Zhe ^{[5
]}

Deng, Yaru ^{[5
]}

Cai, Kaimin ^{[5
]}

Xie, Yi ^{[5
]}

Cao, Zizheng ^{[1
]}

Wang, Dongni ^{[1
]}

Zhang, Xulin ^{[1
]}

Dongye, Meimei ^{[1
]}

Lin, Haotian ^{[1
]}

Wu, Xiaohang ^{[1
]}

机构：

[1] Sun Yat Sen Univ, Zhongshan Ophthalm Ctr, State Key Lab Ophthalmol, Guangzhou, Guangdong, Peoples R China

[2] Guangzhou Univ Chinese Med, Sch Med Informat Engn, Guangzhou, Guangdong, Peoples R China

[3] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou, Guangdong, Peoples R China

[4] Shandong Univ, Qilu Hosp, Jinan, Shandong, Peoples R China

[5] Sun Yat Sen Univ, Zhongshan Sch Med, Guangzhou, Guangdong, Peoples R China

来源：

BRITISH JOURNAL OF OPHTHALMOLOGY | 2024年 / 108卷 / 10期

关键词：

Lens and zonules; Imaging; Retina; QUALITY; RESTORATION;

D O I：

10.1136/bjo-2024-325403

中图分类号：

R77 [眼科学];

学科分类号：

100212 ;

摘要：

Background/aims The aim of this study was to develop and evaluate digital ray, based on preoperative and postoperative image pairs using style transfer generative adversarial networks (GANs), to enhance cataractous fundus images for improved retinopathy detection. Methods For eligible cataract patients, preoperative and postoperative colour fundus photographs (CFP) and ultra-wide field (UWF) images were captured. Then, both the original CycleGAN and a modified CycleGAN (C2ycleGAN) framework were adopted for image generation and quantitatively compared using Frechet Inception Distance (FID) and Kernel Inception Distance (KID). Additionally, CFP and UWF images from another cataract cohort were used to test model performances. Different panels of ophthalmologists evaluated the quality, authenticity and diagnostic efficacy of the generated images. Results A total of 959 CFP and 1009 UWF image pairs were included in model development. FID and KID indicated that images generated by C2ycleGAN presented significantly improved quality. Based on ophthalmologists' average ratings, the percentages of inadequate-quality images decreased from 32% to 18.8% for CFP, and from 18.7% to 14.7% for UWF. Only 24.8% and 13.8% of generated CFP and UWF images could be recognised as synthetic. The accuracy of retinopathy detection significantly increased from 78% to 91% for CFP and from 91% to 93% for UWF. For retinopathy subtype diagnosis, the accuracies also increased from 87%-94% to 91%-100% for CFP and from 87%-95% to 93%-97% for UWF. Conclusion Digital ray could generate realistic postoperative CFP and UWF images with enhanced quality and accuracy for overall detection and subtype diagnosis of retinopathies, especially for CFP.\

引用

页码：1423 / 1429

页数：7

共 21 条

[1] A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy [J].

Beede, Emma ;

Baylor, Elizabeth ;

Hersch, Fred ;

Iurchenko, Anna ;

Wilcox, Lauren ;

Ruamviboonsuk, Paisan ;

Vardoulakis, Laura M. .

PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,

[2]

Bikowski M., 2018, ARXIV

[3] The Clinician and Dataset Shift in Artificial Intelligence [J].

Finlayson, Samuel G. ;

Subbaswamy, Adarsh ;

Singh, Karandeep ;

Bowers, John ;

Kupke, Annabel ;

Zittrain, Jonathan ;

Kohane, Isaac S. ;

Saria, Suchi .

NEW ENGLAND JOURNAL OF MEDICINE, 2021, 385 (03) :283-286

[4]

Heusel M, 2017, ADV NEUR IN, V30

[5] Computer-aided diagnosis based on enhancement of degraded fundus photographs [J].

Jin, Kai ;

Zhou, Mei ;

Wang, Shaoze ;

Lou, Lixia ;

Xu, Yufeng ;

Ye, Juan ;

Qian, Dahong .

ACTA OPHTHALMOLOGICA, 2018, 96 (03) :E320-E326

[6] An Annotation-Free Restoration Network for Cataractous Fundus Images [J].

Li, Heng ;

Liu, Haofeng ;

Hu, Yan ;

Fu, Huazhu ;

Zhao, Yitian ;

Miao, Hanpei ;

Liu, Jiang .

IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) :1699-1710

[7] DeepQuality improves infant retinopathy screening [J].

Li, Longhui ;

Lin, Duoru ;

Lin, Zhenzhe ;

Li, Mingyuan ;

Lian, Zhangkai ;

Zhao, Lanqin ;

Wu, Xiaohang ;

Liu, Lixue ;

Liu, Jiali ;

Wei, Xiaoyue ;

Luo, Mingjie ;

Zeng, Danqi ;

Yan, Anqi ;

Iao, Wai Cheng ;

Shang, Yuanjun ;

Xu, Fabao ;

Xiang, Wei ;

He, Muchen ;

Fu, Zhe ;

Wang, Xueyu ;

Deng, Yaru ;

Fan, Xinyan ;

Ye, Zhijun ;

Wei, Meirong ;

Zhang, Jianping ;

Liu, Baohai ;

Li, Jianqiao ;

Ding, Xiaoyan ;

Lin, Haotian .

NPJ DIGITAL MEDICINE, 2023, 6 (01)

[8] Deep learning from "passive feeding" to "selective eating" of real-world data [J].

Li, Zhongwen ;

Guo, Chong ;

Nie, Danyao ;

Lin, Duoru ;

Zhu, Yi ;

Chen, Chuan ;

Zhao, Lanqin ;

Wu, Xiaohang ;

Dongye, Meimei ;

Xu, Fabao ;

Jin, Chenjin ;

Zhang, Ping ;

Han, Yu ;

Yan, Pisong ;

Lin, Haotian .

NPJ DIGITAL MEDICINE, 2020, 3 (01)

[9] DeepFundus: A flow-cytometry-like image quality classifier for boosting the whole life cycle of medical artificial intelligence [J].

Liu, Lixue ;

Wu, Xiaohang ;

Lin, Duoru ;

Zhao, Lanqin ;

Li, Mingyuan ;

Yun, Dongyuan ;

Lin, Zhenzhe ;

Pang, Jianyu ;

Li, Longhui ;

Wu, Yuxuan ;

Lai, Weiyi ;

Xiao, Wei ;

Shang, Yuanjun ;

Feng, Weibo ;

Tan, Xiao ;

Li, Qiang ;

Liu, Shenzhen ;

Lin, Xinxin ;

Sun, Jiaxin ;

Zhao, Yiqi ;

Yang, Ximei ;

Ye, Qinying ;

Zhong, Yuesi ;

Huang, Xi ;

He, Yuan ;

Fu, Ziwei ;

Xiang, Yi ;

Zhang, Li ;

Zhao, Mingwei ;

Qu, Jinfeng ;

Xu, Fan ;

Lu, Peng ;

Li, Jianqiao ;

Xu, Fabao ;

Wei, Wenbin ;

Dong, Li ;

Dai, Guangzheng ;

He, Xingru ;

Yan, Wentao ;

Zhu, Qiaolin ;

Lu, Linna ;

Zhang, Jiaying ;

Zhou, Wei ;

Meng, Xiangda ;

Li, Shiying ;

Shen, Mei ;

Jiang, Qin ;

Chen, Nan ;

Zhou, Xingtao ;

Li, Meiyan .

CELL REPORTS MEDICINE, 2023, 4 (02)

[10] Prediction of OCT images of short-term response to anti-VEGF treatment for neovascular age-related macular degeneration using generative adversarial network [J].

Liu, Yutong ;

Yang, Jingyuan ;

Zhou, Yang ;

Wang, Weisen ;

Zhao, Jianchun ;

Yu, Weihong ;

Zhang, Dingding ;

Ding, Dayong ;

Li, Xirong ;

Chen, Youxin .

BRITISH JOURNAL OF OPHTHALMOLOGY, 2020, 104 (12) :1735-1740

← 1 2 3 →