Accuracy of ChatGPT in head and neck oncological board decisions: preliminary findings

被引：16
作者：
Lechien, Jerome R. [1 ,2 ,3 ,4 ,5 ]
Chiesa-Estomba, Carlos-Miguel [1 ,6 ]
Baudouin, Robin [1 ,2 ,3 ]
Hans, Stephane [1 ,2 ,3 ]
机构：
[1] Int Federat Oto Rhino Laryngol Soc YO IFOS, Res Comm Young Otolaryngologists, Paris, France
[2] Univ Paris Saclay, Foch Hosp, Dept Otolaryngol Head Neck Surg, UFR Simone Veil, Paris, France
[3] Univ Sorbonne Nouvelle Paris 3, Phonet & Phonol Lab, CNRS, UMR 7018, Paris, France
[4] CHU St Pierre, Dept Otorhinolaryngol & Head & Neck Surg, Brussels, Belgium
[5] EpiCURA Hosp, Dept Otolaryngol Head & Neck Surg, Div Laryngol & Broncho Esophagol, Baudour, Belgium
[6] Hosp Univ Donostia, Dept Otorhinolaryngol Head & Neck Surg, San Sebastian, Spain
来源：
EUROPEAN ARCHIVES OF OTO-RHINO-LARYNGOLOGY | 2024年 / 281卷 / 03期
关键词：
Otolaryngology; Head neck surgery; ChatGPT; Decision; Performance; Artificial intelligence; GPT;
D O I：
10.1007/s00405-023-08326-w
中图分类号：
R76 [耳鼻咽喉科学];
学科分类号：
100213 ;
摘要：
ObjectivesTo evaluate the ChatGPT-4 performance in oncological board decisions.MethodsTwenty medical records of patients with head and neck cancer were evaluated by ChatGPT-4 for additional examinations, management, and therapeutic approaches. The ChatGPT-4 propositions were assessed with the Artificial Intelligence Performance Instrument. The stability of ChatGPT-4 was evaluated through regenerated answers at 1-day interval.ResultsChatGPT-4 provided adequate explanations for cTNM staging in 19 cases (95%). ChatGPT-4 proposed a significant higher number of additional examinations than practitioners (72 versus 103; p = 0.001). ChatGPT-4 indications of endoscopy-biopsy, HPV research, ultrasonography, and PET-CT were consistent with the oncological board decisions. The therapeutic propositions of ChatGPT-4 were accurate in 13 cases (65%). Most additional examination and primary treatment propositions were consistent throughout regenerated response process.ConclusionsChatGPT-4 may be an adjunctive theoretical tool in oncological board simple decisions.
引用
收藏
页码：1565 / 1569
页数：5
相关论文
共 13 条
  • [1] Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support
    Chiesa-Estomba, Carlos M.
    Lechien, Jerome R.
    Vaira, Luigi A.
    Brunet, Aina
    Cammaroto, Giovanni
    Mayo-Yanez, Miguel
    Sanchez-Barrueco, Alvaro
    Saga-Gutierrez, Carlos
    [J]. EUROPEAN ARCHIVES OF OTO-RHINO-LARYNGOLOGY, 2023, 281 (4) : 2081 - 2086
  • [2] French Society of ENT (SFORL) guidelines for care pathway organization in head and neck oncology (short version). Early management of head and neck cancer
    Cuny, F.
    Babin, E.
    Lacau-Saint-Guily, J.
    Baujat, B.
    Bensadoun, R.
    Bozec, A.
    Chevalier, D.
    Choussy, O.
    Deneuve, S.
    Fakhry, N.
    Guigay, J.
    Makeieff, M.
    Merol, J. -C.
    Mouawad, F.
    Pavillet, J.
    Rebiere, C.
    Righini, C.
    Sostras, M. -C.
    Tournaille, M.
    Vergez, S.
    [J]. EUROPEAN ANNALS OF OTORHINOLARYNGOLOGY-HEAD AND NECK DISEASES, 2015, 132 (04) : 205 - 208
  • [3] A Chat(GPT) about the future of scientific publishing
    Hill-Yardin, Elisa L.
    Hutchinson, Mark R.
    Laycock, Robin
    Spencer, Sarah J.
    [J]. BRAIN BEHAVIOR AND IMMUNITY, 2023, 110 : 152 - 154
  • [4] ChatGPT's quiz skills in different otolaryngology subspecialties: an analysis of 2576 single-choice and multiple-choice board certification preparation questions
    Hoch, Cosima C.
    Wollenberg, Barbara
    Lueers, Jan-Christoffer
    Knoedler, Samuel
    Knoedler, Leonard
    Frank, Konstantin
    Cotofana, Sebastian
    Alfertshofer, Michael
    [J]. EUROPEAN ARCHIVES OF OTO-RHINO-LARYNGOLOGY, 2023, 280 (09) : 4271 - 4278
  • [5] ChatGPT performance in laryngology and head and neck surgery: a clinical case-series
    Lechien, Jerome R.
    Georgescu, Bianca M.
    Hans, Stephane
    Chiesa-Estomba, Carlos M.
    [J]. EUROPEAN ARCHIVES OF OTO-RHINO-LARYNGOLOGY, 2024, 281 (01) : 319 - 333
  • [6] Validity and reliability of an instrument evaluating the performance of intelligent chatbot: the Artificial Intelligence Performance Instrument (AIPI)
    Lechien, Jerome R.
    Maniaci, Antonino
    Gengler, Isabelle
    Hans, Stephane
    Chiesa-Estomba, Carlos M.
    Vaira, Luigi A.
    [J]. EUROPEAN ARCHIVES OF OTO-RHINO-LARYNGOLOGY, 2024, 281 (04) : 2063 - 2079
  • [7] Lechien JR, 2023, EUR ARCH OTO-RHINO-L
  • [8] Head and Neck Cancers-Major Changes in the American Joint Committee on Cancer Eighth Edition Cancer Staging Manual
    Lydiatt, William M.
    Patel, Snehal G.
    O'Sullivan, Brian
    Brandwein, Margaret S.
    Ridge, John A.
    Migliacci, Jocelyn C.
    Loomis, Ashley M.
    Shah, Jatin P.
    [J]. CA-A CANCER JOURNAL FOR CLINICIANS, 2017, 67 (02) : 122 - 137
  • [9] Perlis Roy H, 2023, medRxiv, DOI 10.1101/2023.04.14.23288595
  • [10] Salvage carbon dioxide transoral laser microsurgery for laryngeal cancer after (chemo)radiotherapy: a European Laryngological Society consensus statement
    Piazza, Cesare
    Paderno, Alberto
    Sjogren, Elisabeth, V
    Bradley, Patrick J.
    Eckel, Hans E.
    Makitie, Antti
    Matar, Nayla
    Paleri, Vinidh
    Peretti, Giorgio
    Puxeddu, Roberto
    Quer, Miquel
    Remacle, Marc
    Vander Poorten, Vincent
    Vilaseca, Isabel
    Simo, Ricard
    [J]. EUROPEAN ARCHIVES OF OTO-RHINO-LARYNGOLOGY, 2021, 278 (11) : 4373 - 4381
12