The Readiness of ChatGPT to Write Scientific Case Reports Independently: A Comparative Evaluation Between Human and Artificial Intelligence

被引:23
作者
Buholayka, Maryam [1 ,2 ]
Zouabi, Rama [1 ]
Tadinada, Aditya [1 ]
机构
[1] Univ Connecticut Hlth, Oral & Maxillofacial Radiol, Farmington, CT 06030 USA
[2] Imam Abdulrahman Bin Faisal Univ, Dept Biomed Sci, Dammam, Saudi Arabia
关键词
scientific writing and artificial intelligence; artificial intelligence; artificial hallucination; case report; chatgpt;
D O I
10.7759/cureus.39386
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
The use of artificial intelligence (AI) in scientific publishing has gained increased attention, and one AI tool that has been the subject of much discussion is ChatGPT. It is a large language model (LLM) built on the OpenAI platform that aims to emulate human-like writing and continually improves through user interactions. In this paper, ChatGPT's performance was assessed in medical publishing by comparing it to a case report written by oral and maxillofacial radiologists. ChatGPT was tasked with writing a case report based on a drafted report written by the authors in five different prompts. The findings of this study highlight issues related to the accuracy, completeness, and readability of the generated text. These results have significant implications for the future use of AI in scientific publishing and suggest that in the current iteration of ChatGPT, scientific information must be revised by an expert.
引用
收藏
页数:6
相关论文
共 12 条
[1]   Artificial Hallucinations in ChatGPT: Implications in Scientific Writing [J].
Alkaissi, Hussam ;
McFarlane, Samy I. .
CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (02)
[2]  
[Anonymous], 2022, Overview
[3]  
[Anonymous], 2023, FUND VAL
[4]  
Brown TB, 2020, ADV NEUR IN, V33
[5]   Introduction to Machine Learning, Neural Networks, and Deep Learning [J].
Choi, Rene Y. ;
Coyner, Aaron S. ;
Kalpathy-Cramer, Jayashree ;
Chiang, Michael F. ;
Campbell, J. Peter .
TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02)
[6]  
Eke D.O., 2023, J RESPONSIBLE TECHNO, V13, DOI [10.1016/J.JRT.2023.100060, DOI 10.1016/J.JRT.2023.100060]
[7]   Survey of Hallucination in Natural Language Generation [J].
Ji, Ziwei ;
Lee, Nayeon ;
Frieske, Rita ;
Yu, Tiezheng ;
Su, Dan ;
Xu, Yan ;
Ishii, Etsuko ;
Bang, Ye Jin ;
Madotto, Andrea ;
Fung, Pascale .
ACM COMPUTING SURVEYS, 2023, 55 (12)
[8]   Medical Literature Writing With ChatGPT: A Rare Case of Choriocarcinoma Syndrome With Hemorrhagic Brain Metastases Due to Burned Out Metastatic Mixed Testicular Cancer [J].
Le, David P. ;
Hall, Samuel C. .
CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (03)
[9]   The great transformer: Examining the role of large language models in the political economy of AI [J].
Luitse, Dieuwertje ;
Denkena, Wiebke .
BIG DATA & SOCIETY, 2021, 8 (02)
[10]   Use of ChatGPT in Academic Publishing: A Rare Case of Seronegative Systemic Lupus Erythematosus in a Patient With HIV Infection [J].
Manohar, Naveen ;
Prasad, Shruthi S. .
CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (02)