Benchmarking State-of-the-Art Large Language Models for Migraine Patient Education: Performance Comparison of Responses to Common Queries

被引：4

作者：

Li, Linger ^{[1
]}

Li, Pengfei ^{[2
]}

Wang, Kun ^{[1
]}

Zhang, Liang ^{[1
]}

Ji, Hongwei ^{[3
,4
]}

Zhao, Hongqin ^{[1
]}

机构：

[1] Qingdao Univ, Dept Neurol, Affiliated Hosp, 59 Haier Rd, Qingdao 266035, Japan

[2] Qingdao Univ, Affiliated Hosp, Dept Internal Med, Qingdao, Peoples R China

[3] Tsinghua Univ, Tsinghua Med, Beijing, Peoples R China

[4] Beijing Tsinghua Changgung Hosp, Dept Internal Med, Beijing, Peoples R China

来源：

JOURNAL OF MEDICAL INTERNET RESEARCH | 2024年 / 26卷

基金：

中国国家自然科学基金;

关键词：

migraine; large language models; patient education; ChatGPT; Google Bard; language model; education; headache; accuracy; OpenAI; AI; artificial intelligence; AI-assisted; holistic; migraine management; management; MANAGEMENT;

D O I：

10.2196/55927

中图分类号：

R19 [保健组织与事业（卫生事业管理）];

学科分类号：

摘要：

This study assessed the potential of large language models (Open AI's Chat GPT 3.5 and 4.0, Google Bard, Meta Llama2, and Anthropic Claude2) in addressing 30 common migraine-related queries, providing a foundation to advance artificial intelligence-assisted patient education and insights for a holistic approach to migraine management

引用

页数：5

共 9 条

[1] Migraine: epidemiology and systems of care [J].

Ashina, Messoud ;

Katsarava, Zaza ;

Thien Phu Do ;

Buse, Dawn C. ;

Pozo-Rosich, Patricia ;

Ozge, Aynur ;

Krymchantowski, Abouch, V ;

Lebedeva, Elena R. ;

Ravishankar, Krishnamurthy ;

Yu, Shengyuan ;

Sacco, Simona ;

Ashina, Sait ;

Younis, Samaira ;

Steiner, Timothy J. ;

Lipton, Richard B. .

LANCET, 2021, 397 (10283) :1485-1495

[2] Migraine: integrated approaches to clinical management and emerging treatments [J].

Ashina, Messoud ;

Buse, Dawn C. ;

Ashina, Hakan ;

Pozo-Rosich, Patricia ;

Peres, Mario F. P. ;

Lee, Mi Ji ;

Terwindt, Gisela M. ;

Singh, Rashmi Halker ;

Tassorelli, Cristina ;

Thien Phu Do ;

Mitsikostas, Dimos D. ;

Dodick, David W. .

LANCET, 2021, 397 (10283) :1505-1518

[3] Diagnostic accuracy of an artificial intelligence online engine in migraine: A multi-center study [J].

Cowan, Robert P. ;

Rapoport, Alan M. ;

Blythe, Jim ;

Rothrock, John ;

Knievel, Kerry ;

Peretz, Addie M. ;

Ekpo, Elizabeth ;

Sanjanwala, Bharati M. ;

Woldeamanuel, Yohannes W. .

HEADACHE, 2022, 62 (07) :870-882

[4] Burden of Neurological Disorders Across the US From 1990-2017 A Global Burden of Disease Study [J].

Feigin, Valery L. ;

Vos, Theo ;

Alahdab, Fares ;

Amit, Arianna Maever L. ;

Barnighausen, Till Winfried ;

Beghi, Ettore ;

Beheshti, Mahya ;

Chavan, Prachi P. ;

Criqui, Michael H. ;

Desai, Rupak ;

Dhamminda Dharmaratne, Samath ;

Dorsey, E. Ray ;

Wilder Eagan, Arielle ;

Elgendy, Islam Y. ;

Filip, Irina ;

Giampaoli, Simona ;

Giussani, Giorgia ;

Hafezi-Nejad, Nima ;

Hole, Michael K. ;

Ikeda, Takayoshi ;

Owens Johnson, Catherine ;

Kalani, Rizwan ;

Khatab, Khaled ;

Khubchandani, Jagdish ;

Kim, Daniel ;

Koroshetz, Walter J. ;

Krishnamoorthy, Vijay ;

Krishnamurthi, Rita V. ;

Liu, Xuefeng ;

Lo, Warren David ;

Logroscino, Giancarlo ;

Mensah, George A. ;

Miller, Ted R. ;

Mohammed, Salahuddin ;

Mokdad, Ali H. ;

Moradi-Lakeh, Maziar ;

Morrison, Shane Douglas ;

Shivamurthy, Veeresh Kumar N. ;

Naghavi, Mohsen ;

Nichols, Emma ;

Norrving, Bo ;

Odell, Christopher M. ;

Pupillo, Elisabetta ;

Radfar, Amir ;

Roth, Gregory A. ;

Shafieesabet, Azadeh ;

Sheikh, Aziz ;

Sheikhbahaei, Sara ;

Shin, Jae Il ;

Singh, Jasvinder A. .

JAMA NEUROLOGY, 2021, 78 (02) :165-176

[5] Benchmarking large language models' performances for myopia care: a comparative analysis of ChatGPT-3.5, ChatGPT-4.0, and Google Bard [J].

Lim, Zhi Wei ;

Pushpanathan, Krithi ;

Yew, Samantha Min Er ;

Lai, Yien ;

Sun, Chen-Hsin ;

Lam, Janice Sing Harn ;

Chen, David Ziyou ;

Goh, Jocelyn Hui Lin ;

Tan, Marcus Chun Jin ;

Sheng, Bin ;

Cheng, Ching-Yu ;

Koh, Victor Teck Chang ;

Tham, Yih-Chung .

EBIOMEDICINE, 2023, 95

[6] Headache Classification Committee of the International Headache Society (IHS) The International Classification of Headache Disorders, 3rd edition [J].

Olesen, Jes .

CEPHALALGIA, 2018, 38 (01) :1-211

[7] Diagnosis and Management of Headache: A Review [J].

Robbins, Matthew S. .

JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2021, 325 (18) :1874-1885

[8] Large language models encode clinical knowledge [J].

Singhal, Karan ;

Azizi, Shekoofeh ;

Tu, Tao ;

Mahdavi, S. Sara ;

Wei, Jason ;

Chung, Hyung Won ;

Scales, Nathan ;

Tanwani, Ajay ;

Cole-Lewis, Heather ;

Pfohl, Stephen ;

Payne, Perry ;

Seneviratne, Martin ;

Gamble, Paul ;

Kelly, Chris ;

Babiker, Abubakr ;

Schaerli, Nathanael ;

Chowdhery, Aakanksha ;

Mansfield, Philip ;

Demner-Fushman, Dina ;

Arcas, Blaise Aguera y ;

Webster, Dale ;

Corrado, Greg S. ;

Matias, Yossi ;

Chou, Katherine ;

Gottweis, Juraj ;

Tomasev, Nenad ;

Liu, Yun ;

Rajkomar, Alvin ;

Barral, Joelle ;

Semturs, Christopher ;

Karthikesalingam, Alan ;

Natarajan, Vivek .

NATURE, 2023, 620 (7972) :172-+

[9]

Vos T, 2020, LANCET, V396, P1562

← 1 →