ChatGPT's Gastrointestinal Tumor Board Tango: A limping dance partner?

被引:10
作者
Aghamaliyev, Ughur [1 ]
Karimbayli, Javad [2 ]
Giessen-Jung, Clemens [1 ,4 ]
Matthias, Ilmer [1 ,4 ]
Unger, Kristian [4 ,5 ,6 ]
Andrade, Dorian [1 ]
Hofmann, Felix O. [1 ,4 ]
Weniger, Maximilian [1 ]
Angele, Martin K. [1 ]
Westphalen, Benedikt [3 ,4 ]
Werner, Jens [1 ]
Renz, Bernhard W. [1 ,4 ,7 ]
机构
[1] Ludwig Maximilians Univ Munchen, LMU Univ Hosp, Dept Gen Visceral & Transplantat Surg, Munich, Germany
[2] IRCCS, Natl Canc Inst, Ctr Riferimento Oncol Aviano CRO, Div Mol Oncol, Aviano, Italy
[3] Ludwig Maximilians Univ Munchen, LMU Univ Hosp, Comprehens Canc Ctr Munich & Dept Medicine3, Munich, Germany
[4] German Canc Consortium DKTK, Partner Site Munich, Munich, Germany
[5] Ludwig Maximilians Univ Munchen, Univ Hosp, Dept Radiat Oncol, D-81377 Munich, Germany
[6] Bavarian Canc Res Ctr BZKF, Munich, Germany
[7] Ludwig Maximilians Univ Munchen, Hosp Univ Munich, Dept Gen Visceral & Transplantat Surg, Marchioninistr 15, D-81377 Munich, Germany
关键词
ChatGPT; AI; MTB; Concordance; Gastrointestinal cancers; PDAC; CCC; HCC;
D O I
10.1016/j.ejca.2024.114100
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Objectives: This study aimed to assess the consistency and replicability of treatment recommendations provided by ChatGPT 3.5 compared to gastrointestinal tumor cases presented at multidisciplinary tumor boards (MTBs). It also aimed to distinguish between general and case -specific responses and investigated the precision of ChatGPT 's recommendations in replicating exact treatment plans, particularly regarding chemotherapy regimens and follow-up protocols. Material and methods: A retrospective study was carried out on 115 cases of gastrointestinal malignancies, selected from 448 patients reviewed in MTB meetings. A senior resident fed patient data into ChatGPT 3.5 to produce treatment recommendations, which were then evaluated against the tumor board 's decisions by senior oncology fellows. Results: Among the examined cases, ChatGPT 3.5 provided general information about the malignancy without considering individual patient characteristics in 19% of cases. However, only in 81% of cases, ChatGPT generated responses that were specific to the individual clinical scenarios. In the subset of case -specific responses, 83% of recommendations exhibited overall treatment strategy concordance between ChatGPT and MTB. However, the exact treatment concordance dropped to 65%, notably lower in recommending specific chemotherapy regimens. Cases recommended for surgery showed the highest concordance rates, while those involving chemotherapy recommendations faced challenges in precision. Conclusions: ChatGPT 3.5 demonstrates potential in aligning conceptual approaches to treatment strategies with MTB guidelines. However, it falls short in accurately duplicating specific treatment plans, especially concerning chemotherapy regimens and follow-up procedures. Ethical concerns and challenges in achieving exact replication necessitate prudence when considering ChatGPT 3.5 for direct clinical decision -making in MTBs.
引用
收藏
页数:5
相关论文
共 16 条
[1]   The Diagnostic and Management Performance of the ChatGPT in Obstetrics and Gynecology [J].
Allahqoli, Leila ;
Ghiasvand, Mohammad Matin ;
Mazidimoradi, Afrooz ;
Salehiniya, Hamid ;
Alkatout, Ibrahim .
GYNECOLOGIC AND OBSTETRIC INVESTIGATION, 2023, 88 (05) :310-313
[2]  
ChatGPT Generative Pre-trained Transformer, 2022, Oncoscience, V9, P82, DOI 10.18632/oncoscience.571
[3]   ABSTRACTS WRITTEN BY CHATGPT FOOL SCIENTISTS [J].
Else, Holly .
NATURE, 2023, 613 (7944) :423-423
[4]   How Does ChatGPT Perform on the United States Medical Licensing Examination (USMLE)? The Implications of Large Language Models for Medical Education and Knowledge Assessment [J].
Gilson, Aidan ;
Safranek, Conrad W. ;
Huang, Thomas ;
Socrates, Vimig ;
Chi, Ling ;
Taylor, Richard Andrew ;
Chartash, David .
JMIR MEDICAL EDUCATION, 2023, 9
[5]  
Graham Flora, 2022, Nature, DOI 10.1038/d41586-022-04437-2
[6]   Challenging ChatGPT 3.5 in Senology-An Assessment of Concordance with Breast Cancer Tumor Board Decision Making [J].
Griewing, Sebastian ;
Gremke, Niklas ;
Wagner, Uwe ;
Lingenfelder, Michael ;
Kuhn, Sebastian ;
Boekhoff, Jelena .
JOURNAL OF PERSONALIZED MEDICINE, 2023, 13 (10)
[7]   The exciting potential for ChatGPT in obstetrics and gynecology [J].
Grunebaum, Amos ;
Chervenak, Joseph ;
Pollet, Susan L. ;
Katz, Adi ;
Chervenak, Frank A. .
AMERICAN JOURNAL OF OBSTETRICS AND GYNECOLOGY, 2023, 228 (06) :696-705
[8]   Can an artificial intelligence chatbot be the author of a scholarly article? [J].
Lee, Ju Yoen .
JOURNAL OF EDUCATIONAL EVALUATION FOR HEALTH PROFESSIONS, 2023, 20
[9]   Evaluating ChatGPT as an adjunct for the multidisciplinary tumor board decision-making in primary breast cancer cases [J].
Lukac, Stefan ;
Dayan, Davut ;
Fink, Visnja ;
Leinert, Elena ;
Hartkopf, Andreas ;
Veselinovic, Kristina ;
Janni, Wolfgang ;
Rack, Brigitte ;
Pfister, Kerstin ;
Heitmeir, Benedikt ;
Ebner, Florian .
ARCHIVES OF GYNECOLOGY AND OBSTETRICS, 2023, 308 (06) :1831-1844
[10]   ChatGPT and its Role in the Decision-Making for the Diagnosis and Treatment of Lumbar Spinal Stenosis: A Comparative Analysis and Narrative Review [J].
Rajjoub, Rami ;
Arroyave, Juan Sebastian ;
Zaidat, Bashar ;
Ahmed, Wasil ;
Mejia, Mateo Restrepo ;
Tang, Justin ;
Kim, Jun S. ;
Cho, Samuel K. .
GLOBAL SPINE JOURNAL, 2024, 14 (03) :998-1017