Assessing ChatGPT's Diagnostic Accuracy and Therapeutic Strategies in Oral Pathologies: A Cross-Sectional Study

被引:2
|
作者
Uranbey, Oemer [1 ]
Ozbey, Furkan [2 ]
Kaygisiz, Omer [3 ]
Ayranci, Ferhat [1 ]
机构
[1] Ordu Univ, Oral & Maxillofacial Surg, Ordu, Turkiye
[2] Ordu Univ, Oral & Maxillofacial Radiol, Ordu, Turkiye
[3] Gaziantep Univ, Oral & Maxillofacial Surg, Gaziantep, Turkiye
关键词
oral surgery; large language model; oral pathologies; chatgpt; artificial intelligence in healthcare;
D O I
10.7759/cureus.58607
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Background: The rapid adoption of artificial intelligence (AI) models in the medical field is due to their ability to collaborate with clinicians in the diagnosis and management of a wide range of conditions. This research assesses the diagnostic accuracy and therapeutic strategies of Chat Generative Pre -trained Transformer (ChatGPT) in comparison to dental professionals across 12 clinical cases. Methodology: ChatGPT 3.5 was queried for diagnoses and management plans for 12 retrospective cases. Physicians were tasked with rating the complexity of clinical scenarios and their agreement with the ChatGPT responses using a five -point Likert scale. Comparisons were made between the complexity of the cases and the accuracy of the diagnoses and treatment plans. Results: ChatGPT exhibited high accuracy in providing differential diagnoses and acceptable treatment plans. In a survey involving 30 attending physicians, scenarios were rated with an overall median difficulty level of 3, showing acceptable agreement with ChatGPT's differential diagnosis accuracy (overall median 4). Our study revealed lower diagnosis scores correlating with decreased treatment management scores, as demonstrated by univariate ordinal regression analysis. Conclusions: ChatGPT's rapid processing aids healthcare by offering an objective, evidence -based approach, reducing human error and workload. However, potential biases may affect outcomes and challenge lessexperienced practitioners. AI in healthcare, including ChatGPT, is still evolving, and further research is needed to understand its full potential in analyzing clinical information, establishing diagnoses, and suggesting treatments.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Performance of ChatGPT on the India Undergraduate Community Medicine Examination: Cross-Sectional Study
    Gandhi, Aravind P.
    Joesph, Felista Karen
    Rajagopal, Vineeth
    Aparnavi, P.
    Katkuri, Sushma
    Dayama, Sonal
    Satapathy, Prakasini
    Khatib, Mahalaqua Nazli
    Gaidhane, Shilpa
    Zahiruddin, Quazi Syed
    Behera, Ashish
    JMIR FORMATIVE RESEARCH, 2024, 8
  • [2] Performance of ChatGPT in Ophthalmic Registration and ClinicalDiagnosis:Cross-Sectional Study
    Ming, Shuai
    Guo, Xiaohong
    Guo, Qingge
    Xie, Kunpeng
    Chen, Dandan
    Lei, Bo
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2024, 26
  • [3] Performance of ChatGPT on Nursing Licensure Examinations in the United States and China: Cross-Sectional Study
    Wu, Zelin
    Gan, Wenyi
    Xue, Zhaowen
    Ni, Zhengxin
    Zheng, Xiaofei
    Zhang, Yiyi
    JMIR MEDICAL EDUCATION, 2024, 10
  • [4] Assessing the performance of ChatGPT's responses to questions related to epilepsy: A cross-sectional study on natural language processing and medical information retrieval
    Kim, Hyun-Woo
    Shin, Dong-Hyeon
    Kim, Jiyoung
    Lee, Gha-Hyun
    Cho, Jae Wook
    SEIZURE-EUROPEAN JOURNAL OF EPILEPSY, 2024, 114 : 1 - 8
  • [5] "Doctor ChatGPT, Can You Help Me?"The Patient's Perspective:Cross-Sectional Study
    Armbruster, Jonas
    Bussmann, Florian
    Rothhaas, Catharina
    Titze, Nadine
    Gruetzner, Paul Alfred
    Freischmidt, Holger
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2024, 26
  • [6] Attitude and utilization of ChatGPT among registered nurses: A cross-sectional study
    Lin, Hui-Ling
    Liao, Li-Ling
    Wang, Ya-Ni
    Chang, Li-Chun
    INTERNATIONAL NURSING REVIEW, 2025, 72 (02)
  • [7] EXPLORING STUDENTS' AND FACULTY'S KNOWLEDGE, ATTITUDES, AND PERCEPTIONS TOWARDS CHATGPT: A CROSS-SECTIONAL EMPIRICAL STUDY
    Kamoun, Faouzi
    El Ayeb, Walid
    Jabri, Ibtissem
    Sifi, Sami
    Iqbal, Farkhund
    JOURNAL OF INFORMATION TECHNOLOGY EDUCATION-RESEARCH, 2024, 23 : 1 - 33
  • [8] Comparing ChatGPT and clinical nurses' performances on tracheostomy care: A cross-sectional study
    Wang, Tongyao
    Mu, Juan
    Chen, Jialing
    Lin, Chia-Chin
    INTERNATIONAL JOURNAL OF NURSING STUDIES ADVANCES, 2024, 6
  • [9] Medical Student Experiences and Perceptions of ChatGPT and Artificial Intelligence: Cross-Sectional Study
    Alkhaaldi, Saif M., I
    Kassab, Carl H.
    Dimassi, Zakia
    Alsoud, Leen Oyoun
    Al Fahim, Maha
    Al Hageh, Cynthia
    Ibrahim, Halah
    JMIR MEDICAL EDUCATION, 2023, 9
  • [10] Investigation of Pressure Injuries With Visual ChatGPT Integration: A Descriptive Cross-Sectional Study
    Karacay, Pelin
    Goktas, Polat
    Yasar, Ozgen
    Uyanik, Burak
    Uzlu, Sinem
    Coskun, Kubra
    Benk, Mesut
    JOURNAL OF ADVANCED NURSING, 2025,