A User-friendly Approach for the Diagnosis of Diabetic Retinopathy Using ChatGPT and Automated Machine Learning

被引:10
作者
Mohammadi, S. Saeed [1 ]
Nguyen, Quan Dong [1 ,2 ]
机构
[1] Stanford Univ, Byers Eye Inst, Dept Ophthalmol, Palo Alto, CA USA
[2] Stanford Univ, Byers Eye Inst, Spencer Ctr Vis Res, 2370 Watson Court, Suite 200, Palo Alto, CA 94303 USA
来源
OPHTHALMOLOGY SCIENCE | 2024年 / 4卷 / 04期
关键词
arti fi cial intelligence; ChatGPT; Generative Pretrained Transformer; image classi fi cation; machine learning; SYSTEM;
D O I
10.1016/j.xops.2024.100495
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
Purpose: To assess the capabilities of Chat Generative Pre-trained Transformer (ChatGPT) and Vertex AI in executing code -free preprocessing, training machine learning (ML) models, and analyzing the data. Design: Evaluation of diagnostic test or technology. Participants: ChatGPT and Vetrex AI as publicly available large language model and ML platform, respectively. Methods: ChatGPT was employed to improve the resolution of fundus photography images from the Methods to Evaluate Segmentation and Indexing Techniques in the field of Retinal Ophthalmology (Messidor -2) open -source dataset using the Contrast Limited Adaptive Histogram Equalization (CLAHE) technique by Fiji software. Subsequently, Vertex AI, an automated ML (AutoML) platform, was utilized to develop 2 classification models. The first model served as a binary classifier for detecting the presence of diabetic retinopathy (DR), while the second determined its severity. Finally, ChatGPT was used to provide scripts for R and Python programming languages for data analysis and was also directly employed in analyzing the data in a code -free method. Main Outcome Measures: Evaluating the utility of ChatGPT in generating scripts for preprocessing images using Fiji and analyzing data across Python and R and assessing its potential in analyzing data through a codefree method. Investigating the capabilities of Vertex AI to train image classification models for detection of DR and its severity. Results: Two ML models were trained using 1740 images from the Messidor -2 database. The first model, designed to detect the severity of DR, achieved an area under the precision-recall curve (AUPRC) of 0.81, with a precision rate of 81.81% and recall of 72.83%. The second model, tailored for the detection of the presence of DR, recorded a precision and recall of 84.48% with an AUPRC of 0.90. Conclusions: ChatGPT and Vertex AI have the potential to enable physicians without coding expertise to preprocess images, analyze data, and train ML models. Financial Disclosure(s): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article. Ophthalmology Science 2024;4:100495 (c) 2024 by the American Academy of Ophthalmology. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页数:8
相关论文
共 44 条
[1]   Automatic recognition of severity level for diagnosis of diabetic retinopathy using deep visual features [J].
Abbas, Qaisar ;
Fondon, Irene ;
Sarmiento, Auxiliadora ;
Jimenez, Soledad ;
Alemany, Pedro .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2017, 55 (11) :1959-1974
[2]   Deep Learning-Based Prediction of Diabetic Retinopathy Using CLAHE and ESRGAN for Enhancement [J].
Alwakid, Ghadah ;
Gouda, Walaa ;
Humayun, Mamoona .
HEALTHCARE, 2023, 11 (06)
[3]  
[Anonymous], How to use ChatGPT's advanced data analysis feature
[4]   An Ensemble-Based System for Microaneurysm Detection and Diabetic Retinopathy Grading [J].
Antal, Balint ;
Hajdu, Andras .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (06) :1720-1726
[5]   A screening approach to the surveillance of patients with diabetes for the presence of vision-threatening retinopathy [J].
Bresnick, GH ;
Mukamel, DB ;
Dickinson, JC ;
Cole, DR .
OPHTHALMOLOGY, 2000, 107 (01) :19-24
[6]  
Buscemi Alessio, 2023, arXiv
[7]   A deep learning system for detecting diabetic retinopathy across the disease spectrum [J].
Dai, Ling ;
Wu, Liang ;
Li, Huating ;
Cai, Chun ;
Wu, Qiang ;
Kong, Hongyu ;
Liu, Ruhan ;
Wang, Xiangning ;
Hou, Xuhong ;
Liu, Yuexing ;
Long, Xiaoxue ;
Wen, Yang ;
Lu, Lina ;
Shen, Yaxin ;
Chen, Yan ;
Shen, Dinggang ;
Yang, Xiaokang ;
Zou, Haidong ;
Sheng, Bin ;
Jia, Weiping .
NATURE COMMUNICATIONS, 2021, 12 (01)
[8]   ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations [J].
Dave, Tirth ;
Athaluri, Sai Anirudh ;
Singh, Satyam .
FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2023, 6
[10]   FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE [J].
Decenciere, Etienne ;
Zhang, Xiwei ;
Cazuguel, Guy ;
Lay, Bruno ;
Cochener, Beatrice ;
Trone, Caroline ;
Gain, Philippe ;
Ordonez-Varela, John-Richard ;
Massin, Pascale ;
Erginay, Ali ;
Charton, Beatrice ;
Klein, Jean-Claude .
IMAGE ANALYSIS & STEREOLOGY, 2014, 33 (03) :231-234