A SWOT (Strengths, Weaknesses, Opportunities, and Threats) Analysis of ChatGPT in the Medical Literature: Concise Review

被引:36
作者
Goedde, Daniel [1 ,8 ]
Noehl, Sophia [2 ]
Wolf, Carina [2 ]
Rupert, Yannick [2 ]
Rimkus, Lukas [2 ]
Ehlers, Jan [3 ]
Breuckmann, Frank [4 ,5 ]
Sellmann, Timur [6 ,7 ]
机构
[1] Witten Herdecke Univ, Helios Univ Hosp Wuppertal, Dept Pathol & Molecularpathol, Witten, Germany
[2] Witten Herdecke Univ, Fac Hlth, Witten, Germany
[3] Witten Herdecke Univ, Fac Hlth, Dept Didact & Educ Res Hlth Sect, Witten, Germany
[4] Univ Duisburg Essen, West German Heart & Vasc Ctr Essen, Dept Cardiol & Vasc Med, Essen, Germany
[5] Klin Kitzinger Land, Dept Cardiol Pneumol Neurol & Intens Care Med, Kitzingen, Germany
[6] Witten Herdecke Univ, Dept Anaesthesiol 1, Witten, Germany
[7] Evangel Krankenhaus BETHESDA Duisburg, Dept Anaesthesiol & Intens Care Med, Duisburg, Germany
[8] Herdecke Univ, Helios Univ Hosp Wuppertal Witten, Dept Pathol & Molecularpathol, Alfred Herrhausen Str 50, D-58455 Witten, Germany
关键词
ChatGPT; chatbot; artificial intelligence; education technology; medical education; machine learning; chatbots; concise review; review methods; review methodology; SWOT; ARTIFICIAL-INTELLIGENCE; LANGUAGE MODELS; TIME;
D O I
10.2196/49368
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background: ChatGPT is a 175-billion-parameter natural language processing model that is already involved in scientific content and publications. Its influence ranges from providing quick access to information on medical topics, assisting in generating medical and scientific articles and papers, performing medical data analyses, and even interpreting complex data sets. Objective: The future role of ChatGPT remains uncertain and a matter of debate already shortly after its release. This review aimed to analyze the role of ChatGPT in the medical literature during the first 3 months after its release. Methods: We performed a concise review of literature published in PubMed from December 1, 2022, to March 31, 2023. To find all publications related to ChatGPT or considering ChatGPT, the search term was kept simple ("ChatGPT" in AllFields). All publications available as full text in German or English were included. All accessible publications were evaluated according to specifications by the author team (eg, impact factor, publication modus, article type, publication speed, and type of ChatGPT integration or content). The conclusions of the articles were used for later SWOT (strengths, weaknesses, opportunities, and threats) analysis. All data were analyzed on a descriptive basis. Results: Of 178 studies in total, 160 met the inclusion criteria and were evaluated. The average impact factor was 4.423 (range 0-96.216), and the average publication speed was 16 (range 0-83) days. Among the articles, there were 77 editorials (48,1%), 43 essays (26.9%), 21 studies (13.1%), 6 reviews (3.8%), 6 case reports (3.8%), 6 news (3.8%), and 1 meta-analysis (0.6%). Of those, 54.4% (n=87) were published as open access, with 5% (n=8) provided on preprint servers. Over 400 quotes with information on strengths, weaknesses, opportunities, and threats were detected. By far, most (n=142, 34.8%) were related to weaknesses. ChatGPT excels in its ability to express ideas clearly and formulate general contexts comprehensibly. It performs so well that even experts in the field have difficulty identifying abstracts generated by ChatGPT. However, the time-limited scope and the need for corrections by experts were mentioned as weaknesses and threats of ChatGPT. Opportunities include assistance in formulating medical issues for nonnative English speakers, as well as the possibility of timely participation in the development of such artificial intelligence tools since it is in its early stages and can therefore still be influenced. Conclusions: Artificial intelligence tools such as ChatGPT are already part of the medical publishing landscape. Despite their apparent opportunities, policies and guidelines must be implemented to ensure benefits in education, clinical practice, and research and protect against threats such as scientific misconduct, plagiarism, and inaccuracy.
引用
收藏
页数:13
相关论文
共 54 条
[1]   Using ChatGPT to write patient clinic letters [J].
Ali, Stephen R. ;
Dobbs, Thomas D. ;
Hutchings, Hayley A. ;
Whitaker, Iain S. .
LANCET, 2023, 5 (04) :E179-E181
[2]   Time from submission to publication varied widely for biomedical journals: a systematic review [J].
Andersen, Mikkel Zola ;
Fonnes, Siv ;
Rosenberg, Jacob .
CURRENT MEDICAL RESEARCH AND OPINION, 2021, 37 (06) :985-993
[3]  
[Anonymous], DEF ROL AUTH CONTR
[4]  
[Anonymous], 2003, Wikipedia
[5]  
[Anonymous], The use of AI and AI-assisted writing technologies in scientific writing
[6]   Time from submission to publication in plastic surgery journals: The story of accepted manuscripts [J].
Asaad, Malke ;
Rajesh, Aashish ;
Banuelos, Joseph ;
Vyas, Krishna S. ;
Tran, Nho, V .
JOURNAL OF PLASTIC RECONSTRUCTIVE AND AESTHETIC SURGERY, 2020, 73 (02) :383-390
[7]   Artificial intelligence and ChatGPT between worst enemy and best friend: The two faces of a revolution and its impact on science and medical schools [J].
Aubignat, M. ;
Diab, E. .
REVUE NEUROLOGIQUE, 2023, 179 (06) :520-522
[9]   The role of using ChatGPT AI in writing medical scientific articles [J].
Benichou, L. .
JOURNAL OF STOMATOLOGY ORAL AND MAXILLOFACIAL SURGERY, 2023, 124 (05)
[10]  
Benoit JRA, 2023, medRxiv, DOI [10.1101/2023.02.04.23285478, 10.1101/2023.02.04.23285478, DOI 10.1101/2023.02.04.23285478]