Optimizing Readability of Patient-Facing Hand Surgery Education Materials Using Chat Generative Pretrained Transformer (ChatGPT) 3.5

被引:11
作者
Vallurupalli, Medha [1 ]
Shah, Nikhil D. [2 ]
Vyas, Raj M. [2 ,3 ]
机构
[1] Univ Southern Calif, Keck Sch Med, Los Angeles, CA USA
[2] Univ Calif Orange, Dept Plast Surg, 200 S Manchester Ave,Suite 650, Orange, CA 92868 USA
[3] Childrens Hosp Orange Cty, Orange, CA USA
来源
JOURNAL OF HAND SURGERY-AMERICAN VOLUME | 2024年 / 49卷 / 10期
关键词
Artificial intelligence; health literacy; readability; HEALTH LITERACY; ONLINE RESOURCES;
D O I
10.1016/j.jhsa.2024.05.007
中图分类号
R826.8 [整形外科学]; R782.2 [口腔颌面部整形外科学]; R726.2 [小儿整形外科学]; R62 [整形外科学(修复外科学)];
学科分类号
摘要
Purpose To address patient health literacy, the American Medical Association and the National Institutes of Health recommend that readability of patient education materials should not exceed an eighth grade reading level. However, patient-facing materials often remain above the recommended average reading level. Current online calculators provide readability scores; however, they lack the ability to provide text-specific feedback, which may streamline the process of simplifying patient materials. The purpose of this study was to evaluate Chat Generative Pretrained Transformer (ChatGPT) 3.5 as a tool for optimizing patient-facing hand surgery education materials through reading level analysis and simplification. Methods The readability of 18 patient-facing hand surgery education materials was compared by a traditional online calculator for reading level and ChatGPT 3.5. The original excerpts were then entered into ChatGPT 3.5 and simplified by the artificial intelligence tool. The simplified excerpts were scored by the same calculators. Results The readability scores for the original excerpts from the online calculator and ChatGPT 3.5 were similar. The simplified excerpts' scores were lower than the originals, with a mean of 7.28, less than the maximum recommended 8. Conclusions The use of ChatGPT 3.5 for the purpose of simplification and readability analysis of patient-facing hand surgery materials is efficient and may help facilitate the conveyance of important health information. ChatGPT 3.5 rendered readability scores comparable with traditional readability calculators, in addition to excerpt-specific feedback. It was also able to simplify materials to the recommended grade levels.
引用
收藏
页码:986 / 991
页数:6
相关论文
共 33 条
[1]  
[Anonymous], An Introduction to Health Literacy
[2]  
[Anonymous], HLTH LIT
[3]   Missing the Mark: The State of Health Care Literacy in Plastic Surgery [J].
Barton, Natalie ;
Janis, Jeffrey E. .
PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN, 2020, 8 (05)
[4]   Evaluation of Health Literacy in Plastic Surgery Using a Crowdsourced Patient Survey [J].
Bustos, Valeria P. ;
Haddad, Anthony ;
Kinney, JacqueLyn R. ;
Xun, Helen ;
Nassar, Amer H. ;
Lee, Theodore ;
Lin, Samuel J. ;
Lee, Bernard T. .
PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN, 2023, 11 (02) :E4803
[5]   Social Media: Is the Message Reaching the Plastic Surgery Audience? [J].
Chen, Austin D. ;
Ruan, Qing Zhao ;
Bucknor, Alexandra ;
Chattha, Anmol S. ;
Bletsis, Patrick P. ;
Furnas, Heather J. ;
Lee, Bernard T. ;
Lin, Samuel J. .
PLASTIC AND RECONSTRUCTIVE SURGERY, 2019, 144 (03) :773-781
[6]   A Multimetric Health Literacy Analysis of Autologous Versus Implant-Based Breast Reconstruction [J].
Chen, Daniel H. ;
Johnson, Anna Rose ;
Ayyala, Haripriya ;
Lee, Edward S. ;
Lee, Bernard T. ;
Tran, Bao Ngoc N. .
ANNALS OF PLASTIC SURGERY, 2020, 85 :S102-S108
[7]   Appropriateness and Reliability of an Online Artificial Intelligence Platform's Responses to Common Questions Distal Radius Fractures [J].
Christy, Michele ;
Morris, Marie T. ;
Goldfarb, Charles A. ;
Dy, Christopher J. .
JOURNAL OF HAND SURGERY-AMERICAN VOLUME, 2024, 49 (02) :91-98
[8]  
Cook Julia A, 2018, Hand (N Y), V13, P547, DOI 10.1177/1558944717725384
[9]   Evaluation of Online Artificial Intelligence-Generated Information on Common Hand Procedures [J].
Crook, Bryan S. ;
Park, Caroline N. ;
Hurley, Eoghan T. ;
Richard, Marc J. ;
Pidgeon, Tyler S. .
JOURNAL OF HAND SURGERY-AMERICAN VOLUME, 2023, 48 (11) :1122-1127
[10]   Literacy and health outcomes - A systematic review of the literature [J].
DeWalt, DA ;
Berkman, ND ;
Sheridan, S ;
Lohr, KN ;
Pignone, MP .
JOURNAL OF GENERAL INTERNAL MEDICINE, 2004, 19 (12) :1228-1239