Artificial Intelligence and Public Health: Evaluating ChatGPT Responses to Vaccination Myths and Misconceptions

被引:61
作者
Deiana, Giovanna [1 ,2 ]
Dettori, Marco [2 ,3 ,4 ]
Arghittu, Antonella [3 ]
Azara, Antonio [2 ,3 ]
Gabutti, Giovanni [5 ]
Castiglia, Paolo [2 ,3 ,5 ]
机构
[1] Univ Sassari, Dept Biomed Sci, I-07100 Sassari, Italy
[2] Univ Hosp Sassari, Dept Med Surg & Expt Sci, I-07100 Sassari, Italy
[3] Univ Sassari, Dept Med Surg & Pharm, I-07100 Sassari, Italy
[4] Univ Bern, Dept Restorat Pediat & Prevent Dent, CH-3012 Bern, Switzerland
[5] Italian Soc Hyg Prevent Med & Publ Hlth, Working Grp Vaccines & Immunizat Pol, I-16030 Cogorno, Italy
关键词
ChatGPT; vaccines; immunization; myths and misconceptions; public health; artificial intelligence; IMPACT;
D O I
10.3390/vaccines11071217
中图分类号
R392 [医学免疫学]; Q939.91 [免疫学];
学科分类号
100102 ;
摘要
Artificial intelligence (AI) tools, such as ChatGPT, are the subject of intense debate regarding their possible applications in contexts such as health care. This study evaluates the Correctness, Clarity, and Exhaustiveness of the answers provided by ChatGPT on the topic of vaccination. The World Health Organization's 11 "myths and misconceptions" about vaccinations were administered to both the free (GPT-3.5) and paid version (GPT-4.0) of ChatGPT. The AI tool's responses were evaluated qualitatively and quantitatively, in reference to those myth and misconceptions provided by WHO, independently by two expert Raters. The agreement between the Raters was significant for both versions (p of K < 0.05). Overall, ChatGPT responses were easy to understand and 85.4% accurate although one of the questions was misinterpreted. Qualitatively, the GPT-4.0 responses were superior to the GPT-3.5 responses in terms of Correctness, Clarity, and Exhaustiveness (& UDelta; = 5.6%, 17.9%, 9.3%, respectively). The study shows that, if appropriately questioned, AI tools can represent a useful aid in the health care field. However, when consulted by non-expert users, without the support of expert medical advice, these tools are not free from the risk of eliciting misleading responses. Moreover, given the existing social divide in information access, the improved accuracy of answers from the paid version raises further ethical issues.
引用
收藏
页数:13
相关论文
共 73 条
[1]  
Al Hakim Z., 2023, BOER TECNOLOGY
[2]  
[Anonymous], 2023, Timing and Spacing of Immunobiologics
[3]  
[Anonymous], 2022, Deep Deterministic Policy Gradient
[4]   First Year of Special Issue "New Insights in Vaccination and Public Health": Opinions and Considerations [J].
Arghittu, Antonella ;
Dettori, Marco ;
Castiglia, Paolo .
VACCINES, 2023, 11 (03)
[5]   Knowledge, Attitudes, and Behaviors towards Proper Nutrition and Lifestyles in Italian Diabetic Patients during the COVID-19 Pandemic [J].
Arghittu, Antonella ;
Deiana, Giovanna ;
Castiglia, Elena ;
Pacifico, Adolfo ;
Brizzi, Patrizia ;
Cossu, Andrea ;
Castiglia, Paolo ;
Dettori, Marco .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2022, 19 (18)
[6]  
Arghittu Antonella, 2021, Acta Biomed, V92, pe2021456, DOI 10.23750/abm.v92iS6.12072
[7]   Health Communication in COVID-19 Era: Experiences from the Italian VaccinarSi Network Websites [J].
Arghittu, Antonella ;
Dettori, Marco ;
Dempsey, Emma ;
Deiana, Giovanna ;
Angelini, Claudio ;
Bechini, Angela ;
Bertoni, Caterina ;
Boccalini, Sara ;
Bonanni, Paolo ;
Cinquetti, Sandro ;
Chiesi, Fabrizio ;
Chironna, Maria ;
Costantino, Claudio ;
Ferro, Antonio ;
Fiacchini, Daniel ;
Icardi, Giancarlo ;
Poscia, Andrea ;
Russo, Francesca ;
Siddu, Andrea ;
Spadea, Antonietta ;
Sticchi, Laura ;
Triassi, Maria ;
Vitale, Francesco ;
Castiglia, Paolo .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2021, 18 (11)
[8]   Flu Vaccination Attitudes, Behaviours, and Knowledge among Health Workers [J].
Arghittu, Antonella ;
Dettori, Marco ;
Azara, Antonio ;
Gentili, Davide ;
Serra, Antonello ;
Contu, Bruno ;
Castiglia, Paolo .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2020, 17 (09)
[9]  
Brown TB, 2020, ADV NEUR IN, V33
[10]  
Burak A., 2023, RELEVANT