Beyond the Scalpel: Assessing ChatGPT's potential as an auxiliary intelligent virtual assistant in oral surgery

被引:36
作者
Suarez, Ana [1 ]
Jimenez, Jaime [2 ]
de Pedro, Maria Llorente
Andreu-Vazquez, Cristina [3 ]
Garcia, Victor Diaz-Flores [1 ]
Sanchez, Margarita Gomez [1 ]
Freire, Yolanda [1 ]
机构
[1] Univ Europea Madrid, Fac Biomed & Hlth Sci, Dept Pre Clin Dent, Calle Tajo s-n,Villaviciosa Odon, Madrid 28670, Spain
[2] Univ Europea Madrid, Fac Biomed & Hlth Sci, Dept Clin Dent, Calle Tajo S-N, Villaviciosa De Odon 28670, Madrid, Spain
[3] Univ Europea Madrid, Fac Biomed & Hlth Sci, Dept Vet Med, Calle Tajo S-N, Villaviciosa De Odon 28670, Madrid, Spain
关键词
Oral surgery; Artificial Intelligence; ChatGPT; Open AI; Chatbot; Dentistry; Large language models; Natural generative language; HALLUCINATIONS; PERFORMANCE; QUESTIONS; ACCURACY;
D O I
10.1016/j.csbj.2023.11.058
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
AI has revolutionized the way we interact with technology. Noteworthy advances in AI algorithms and large language models (LLM) have led to the development of natural generative language (NGL) systems such as ChatGPT. Although these LLM can simulate human conversations and generate content in real time, they face challenges related to the topicality and accuracy of the information they generate. This study aimed to assess whether ChatGPT-4 could provide accurate and reliable answers to general dentists in the field of oral surgery, and thus explore its potential as an intelligent virtual assistant in clinical decision making in oral surgery.Thirty questions related to oral surgery were posed to ChatGPT4, each question repeated 30 times. Subse-quently, a total of 900 responses were obtained. Two surgeons graded the answers according to the guidelines of the Spanish Society of Oral Surgery, using a three-point Likert scale (correct, partially correct/incomplete, and incorrect). Disagreements were arbitrated by an experienced oral surgeon, who provided the final grade Accu-racy was found to be 71.7%, and consistency of the experts' grading across iterations, ranged from moderate to almost perfect.ChatGPT-4, with its potential capabilities, will inevitably be integrated into dental disciplines, including oral surgery. In the future, it could be considered as an auxiliary intelligent virtual assistant, though it would never replace oral surgery experts. Proper training and verified information by experts will remain vital to the implementation of the technology. More comprehensive research is needed to ensure the safe and successful application of AI in oral surgery.
引用
收藏
页码:46 / 52
页数:7
相关论文
共 70 条
[1]   Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions [J].
Abd-alrazaq, Alaa ;
AlSaad, Rawan ;
Alhuwail, Dari ;
Ahmed, Arfan ;
Healy, Padraig Mark ;
Latifi, Syed ;
Aziz, Sarah ;
Damseh, Rafat ;
Alrazak, Sadam Alabed ;
Sheikh, Javaid .
JMIR MEDICAL EDUCATION, 2023, 9
[2]   Exploring the Ethical, Legal, and Social Implications of ChatGPT in Urology [J].
Adhikari, Kinju ;
Naik, Nithesh ;
Hameed, B. M. Zeeshan ;
Raghunath, S. K. ;
Somani, Bhaskar K. .
CURRENT UROLOGY REPORTS, 2024, 25 (01) :1-8
[3]   ChatGPT and Lacrimal Drainage Disorders: Performance and Scope of Improvement [J].
Ali, Mohammad Javed .
OPHTHALMIC PLASTIC AND RECONSTRUCTIVE SURGERY, 2023, 39 (03) :221-225
[4]   Artificial Hallucinations in ChatGPT: Implications in Scientific Writing [J].
Alkaissi, Hussam ;
McFarlane, Samy I. .
CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (02)
[5]   Evaluating the Performance of ChatGPT in Ophthalmology [J].
Antaki, Fares ;
Touma, Samir ;
Milad, Daniel ;
El -Khoury, Jonathan ;
Duval, Renaud .
OPHTHALMOLOGY SCIENCE, 2023, 3 (04)
[6]   The future of medical education and research: Is ChatGPT a blessing or blight in disguise? [J].
Arif, Taha Bin ;
Munaf, Uzair ;
Ul-Haque, Ibtehaj .
MEDICAL EDUCATION ONLINE, 2023, 28 (01)
[7]   Exploring the Boundaries of Reality: Investigating the Phenomenon of Artificial Intelligence Hallucination in Scientific Writing Through ChatGPT References [J].
Athaluri, Sai Anirudh ;
Manthena, Sandeep Varma ;
Kesapragada, V. S. R. Krishna Manoj ;
Yarlagadda, Vineel ;
Dave, Tirth ;
Duddumpudi, Rama Tulasi Siri .
CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (04)
[8]   Can ChatGPT be used in oral and maxillofacial surgery? [J].
Balel, Yunus .
JOURNAL OF STOMATOLOGY ORAL AND MAXILLOFACIAL SURGERY, 2023, 124 (05)
[9]   Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study [J].
Bennion, Matthew Russell ;
Hardy, Gillian E. ;
Moore, Roger K. ;
Kellett, Stephen ;
Millings, Abigail .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2020, 22 (05)
[10]   ChatGPT and the Future of Medical Writing [J].
Biswas, Som .
RADIOLOGY, 2023, 307 (02)