What if your patient switches from Dr. Google to Dr. ChatGPT? A vignette-based survey of the trustworthiness, value, and danger of ChatGPT-generated responses to health questions

被引：79

作者：

Van Bulck, Liesbet ^{[1
,2
]}

Moons, Philip ^{[1
,3
,4
]}

机构：

[1] KU Leuven Univ Leuven, KU Leuven Dept Publ Hlth & Primary Care, Kapucijnenvoer 35 PB7001, B-3000 Leuven, Belgium

[2] Res Fdn Flanders FWO, Leuvenseweg 38, B-1000 Brussels, Belgium

[3] Univ Gothenburg, Inst Hlth & Care Sci, Arvid Wallgrens Backe 1, S-41346 Gothenburg, Sweden

[4] Univ Cape Town, Dept Paediat & Child Hlth, Klipfontein Rd, ZA-7700 Cape Town, South Africa

来源：

EUROPEAN JOURNAL OF CARDIOVASCULAR NURSING | 2024年 / 23卷 / 01期

关键词：

Artificial intelligence; Chatbot; Language models; Natural language processing; Nursing; Nurses; Patient information; Safety;

D O I：

10.1093/eurjcn/zvad038

中图分类号：

R5 [内科学];

学科分类号：

1002 ; 100201 ;

摘要：

ChatGPT is a new artificial intelligence system that revolutionizes the way how information can be sought and obtained. In this study, the trustworthiness, value, and danger of ChatGPT-generated responses on four vignettes that represented virtual patient questions were evaluated by 20 experts in the domain of congenital heart disease, atrial fibrillation, heart failure, or cholesterol. Experts generally considered ChatGPT-generated responses trustworthy and valuable, with few considering them dangerous. Forty percent of the experts found ChatGPT responses more valuable than Google. Experts appreciated the sophistication and nuances in the responses but also recognized that responses were often incomplete and sometimes misleading.

引用

页码：95 / 98

页数：4

共 10 条

[1]

Antaki F., 2023, MEDRXIV, DOI DOI 10.1101/2023.01.22.23284882

[2]

Duong D., 2023, PREPRINT, DOI [10.1101/2023.01.27.2328511, DOI 10.1101/2023.01.27.2328511]

[3] Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift [J].

Hopkins, Ashley M. ;

Logan, Jessica M. ;

Kichenadasse, Ganessan ;

Sorich, Michael J. .

JNCI CANCER SPECTRUM, 2023, 7 (02)

[4] Survey of Hallucination in Natural Language Generation [J].

Ji, Ziwei ;

Lee, Nayeon ;

Frieske, Rita ;

Yu, Tiezheng ;

Su, Dan ;

Xu, Yan ;

Ishii, Etsuko ;

Bang, Ye Jin ;

Madotto, Andrea ;

Fung, Pascale .

ACM COMPUTING SURVEYS, 2023, 55 (12)

[5] Dr Google, MD: a survey of mental health-related internet use in a private practice sample [J].

Lam-Po-Tang, John ;

McKay, Diana .

AUSTRALASIAN PSYCHIATRY, 2010, 18 (02) :130-133

[6]

Lee BruceY., 2019, Forbes

[7] ChatGPT: can artificial intelligence language models be of value for cardiovascular nurses and allied health professionals [J].

Moons, Philip ;

Van Bulck, Liesbet .

EUROPEAN JOURNAL OF CARDIOVASCULAR NURSING, 2023, 22 (07) :E55-E59

[8] ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns [J].

Sallam, Malik .

HEALTHCARE, 2023, 11 (06)

[9]

Van Bulck L., 2023, Eur. J. Cardiovasc. Nurs., P1

[10]

Yeo YH., 2023, Clin Mol Hepatol, DOI [10.1101/2023.02.06.23285449, DOI 10.1101/2023.02.06.23285449]

← 1 →