The Readiness of ChatGPT to Write Scientific Case Reports Independently: A Comparative Evaluation Between Human and Artificial Intelligence

被引:17
|
作者
Buholayka, Maryam [1 ,2 ]
Zouabi, Rama [1 ]
Tadinada, Aditya [1 ]
机构
[1] Univ Connecticut Hlth, Oral & Maxillofacial Radiol, Farmington, CT 06030 USA
[2] Imam Abdulrahman Bin Faisal Univ, Dept Biomed Sci, Dammam, Saudi Arabia
关键词
scientific writing and artificial intelligence; artificial intelligence; artificial hallucination; case report; chatgpt;
D O I
10.7759/cureus.39386
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
The use of artificial intelligence (AI) in scientific publishing has gained increased attention, and one AI tool that has been the subject of much discussion is ChatGPT. It is a large language model (LLM) built on the OpenAI platform that aims to emulate human-like writing and continually improves through user interactions. In this paper, ChatGPT's performance was assessed in medical publishing by comparing it to a case report written by oral and maxillofacial radiologists. ChatGPT was tasked with writing a case report based on a drafted report written by the authors in five different prompts. The findings of this study highlight issues related to the accuracy, completeness, and readability of the generated text. These results have significant implications for the future use of AI in scientific publishing and suggest that in the current iteration of ChatGPT, scientific information must be revised by an expert.
引用
收藏
页数:6
相关论文
共 15 条
  • [1] Exploring the use of generative artificial intelligence in systematic searching: A comparative case study of a human librarian, ChatGPT-4 and ChatGPT-4 Turbo
    Chen, Xiayu Summer
    Feng, Yali
    IFLA JOURNAL-INTERNATIONAL FEDERATION OF LIBRARY ASSOCIATIONS, 2025, 51 (01): : 84 - 93
  • [2] ChatGPT, the voice from elsewhere: a poetic and therapeutic dialog between human and artificial intelligence
    Santarpia, Alfonso
    JOURNAL OF POETRY THERAPY, 2024,
  • [3] Quality of Information Provided by Artificial Intelligence Chatbots Surrounding the Management of Vestibular Schwannomas: A Comparative Analysis Between ChatGPT-4 and Claude 2
    Borsetto, Daniele
    Sia, Egidio
    Axon, Patrick
    Donnelly, Neil
    Tysome, James R.
    Anschuetz, Lukas
    Bernardeschi, Daniele
    Capriotti, Vincenzo
    Caye-Thomasen, Per
    West, Niels Cramer
    Erbele, Isaac D.
    Franchella, Sebastiano
    Gatto, Annalisa
    Hess-Erga, Jeanette
    Kunst, Henricus P. M.
    Marinelli, John P.
    Mannion, Richard
    Panizza, Benedict
    Trabalzini, Franco
    Obholzer, Rupert
    Vaira, Luigi Angelo
    Polesel, Jerry
    Giudici, Fabiola
    Carlson, Matthew L.
    Tirelli, Giancarlo
    Boscolo-Rizzo, Paolo
    OTOLOGY & NEUROTOLOGY, 2025, 46 (04) : 432 - 436
  • [4] Utilizing artificial intelligence in academic writing: an in-depth evaluation of a scientific review on fertility preservation written by ChatGPT-4
    Safrai, Myriam
    Orwig, Kyle E.
    JOURNAL OF ASSISTED REPRODUCTION AND GENETICS, 2024, 41 (07) : 1871 - 1880
  • [5] Cognitive Domain Assessment of Artificial Intelligence Chatbots: A Comparative Study Between ChatGPT and Gemini's Understanding of Anatomy Education
    Ganapathy, Arthi
    Kaushal, Parul
    MEDICAL SCIENCE EDUCATOR, 2025,
  • [6] Artificial Versus Human Intelligence in the Diagnostic Approach of Ophthalmic Case Scenarios: A Qualitative Evaluation of Performance and Consistency
    Mandalos, Achilleas
    Tsouris, Dimitrios
    CUREUS JOURNAL OF MEDICAL SCIENCE, 2024, 16 (06)
  • [7] Comparative analysis between artificial and human intelligence in the teaching of higher education journalism studies
    Abarca, Juan Pablo Mateos
    Miranda-Galbe, Jorge
    ENCONTROS BIBLI-REVISTA ELETRONICA DE BIBLIOTECONOMIA E CIENCIA DA INFORMACAO, 2025, 30
  • [8] Evaluation of Advanced Artificial Intelligence Algorithms' Diagnostic Efficacy in Acute Ischemic Stroke: A Comparative Analysis of ChatGPT-4o and Claude 3.5 Sonnet Models
    Koyun, Mustafa
    Taskent, Ismail
    JOURNAL OF CLINICAL MEDICINE, 2025, 14 (02)
  • [9] VIRTSI: A novel trust dynamics model enhancing Artificial Intelligence collaboration with human users - Insights from a ChatGPT evaluation study
    Virvou, Maria
    Tsihrintzis, George A.
    Tsichrintzi, Evangelia-Aikaterini
    INFORMATION SCIENCES, 2024, 675
  • [10] Variability between human experts and artificial intelligence in identification of anatomical structures by ultrasound in regional anaesthesia: a framework for evaluation of assistive artificial intelligence
    Bowness, James S.
    Morse, Robert
    Lewis, Owen
    Lloyd, James
    Burckett-St Laurent, David
    Bellew, Boyne
    Macfarlane, Alan J. R.
    Pawa, Amit
    Taylor, Alasdair
    Noble, J. Alison
    Higham, Helen
    BRITISH JOURNAL OF ANAESTHESIA, 2024, 132 (05) : 1063 - 1072