Can artificial intelligence (AI) educate your patient? A study to assess overall readability and pharmacists' perception of AI-generated patient education materials

被引:1
|
作者
Armstrong, Drew [1 ]
Paul, Caroline [2 ]
McGlaughlin, Brent [1 ]
Hill, David [1 ]
机构
[1] Reg One Hlth, 877 Jefferson Ave, Memphis, TN 38103 USA
[2] UTHSC Coll Pharm, Memphis, TN USA
关键词
artificial intelligence; disease; education; patient education; pharmaceutical preparations; REPORTING QUALITATIVE RESEARCH;
D O I
10.1002/jac5.2006
中图分类号
R9 [药学];
学科分类号
1007 ;
摘要
Introduction: Pharmacists are critical in providing safe and accurate education to patients on disease states and medications. Artificial intelligence (AI) has the capacity to generate patient education materials at a rapid rate, potentially saving healthcare resources. However, overall accuracy and comfort with these materials by pharmacists need to be assessed. Objective: The purpose of this study was to assess the accuracy, readability, and likelihood of using AI-generated patient education materials for ten common medications and disease states. Methods: AI (Chat Generative Pre-Trained Transformer [ChatGPT] v3.5) was used to create patient education materials for the following medications or disease states: apixaban, Continuous Glucose Monitoring (CGM), the Dietary Approaches to Stop Hypertension (DASH) Diet, enoxaparin, hypertension, hypoglycemia, myocardial infarction, naloxone, semaglutide, and warfarin. The following prompt, "Write a patient education material for & mldr;" with these medications or disease states being at the end of the prompt, was entered into the ChatGPT (OpenAI, San Francisco, CA) software. A similar prompt, "Write a patient education material for & mldr;at a 6th-grade reading level or lower" using the same medications and disease states, was then completed. Ten clinical pharmacists were asked to review and assess the time it took them to review each educational material, make clinical and grammatical edits, their confidence in the clinical accuracy of the materials, and the likelihood that they would use them with their patients. These education materials were assessed for readability using the Flesh-Kincaid readability score. Results: A total of 8 pharmacists completed both sets of reviews for a total of 16 patient education materials assessed. There was no statistical difference in any pharmacist assessment completed between the two prompts. The overall confidence in accuracy was fair, and the overall readability score of the AI-generated materials decreased from 11.65 to 5.87 after reviewing the 6th-grade prompt (p < .001). Conclusion: AI-generated patient education materials show promise in clinical practice, however further validation of their clinical accuracy continues to be a burden. It is important to ensure that overall readability for patient education materials is at an appropriate level to increase the likelihood of patient understanding.
引用
收藏
页码:803 / 808
页数:6
相关论文
共 33 条
  • [31] Wound imaging software and digital platform to assist review of surgical wounds using patient smartphones: The development and evaluation of artificial intelligence (WISDOM AI study)
    Rochon, Melissa
    Tanner, Judith
    Jurkiewicz, James
    Beckhelling, Jacqueline
    Aondoakaa, Akuha
    Wilson, Keith
    Dhoonmoon, Luxmi
    Underwood, Max
    Mason, Lara
    Harris, Roy
    Cariaga, Karen
    PLOS ONE, 2024, 19 (12):
  • [32] Assessing the impact of information on patient attitudes toward artificial intelligence-based clinical decision support (AI/CDS): a pilot web-based SMART vignette study
    Kim, Bohye
    Ryan, Katie
    Kim, Jane Paik
    JOURNAL OF MEDICAL ETHICS, 2024,
  • [33] Can Artificial Intelligence Help Improve Medical Literacy in Patients With Educational Disparities? A Pilot Study Assessing the Role of Chat GPT in Colonoscopy (CS) and Esophagogastroduodenoscopy (EGD) Patient Education
    Ingawale, Sushrut
    Pena, Oscar
    Chennakesavulu, Pujitha Vallivedu
    Mishra, Monika
    AMERICAN JOURNAL OF GASTROENTEROLOGY, 2024, 119 (10S): : S601 - S602