Can Artificial Intelligence Improve the Readability of Patient Education Materials?

被引:52
|
作者
Kirchner, Gregory J. [1 ,2 ]
Kim, Raymond Y. [1 ]
Weddle, John B. [1 ]
Bible, Jesse E. [1 ]
机构
[1] Penn State Milton S Hershey Med Ctr, Dept Orthopaed & Rehabil, Hershey, PA USA
[2] Penn State Milton S Hershey Med Ctr, Dept Orthopaed & Rehabil, 700 HMC Crescent Rd,Mail Code H089, Hershey, PA 17033 USA
关键词
HEALTH LITERACY; INFORMATION LEAFLETS; ORTHOPEDIC SURGEONS; AMERICAN ACADEMY;
D O I
10.1097/CORR.0000000000002668
中图分类号
R826.8 [整形外科学]; R782.2 [口腔颌面部整形外科学]; R726.2 [小儿整形外科学]; R62 [整形外科学(修复外科学)];
学科分类号
摘要
Background:<br />The recommended readability of online health education materials is at or below the sixth- to eighth-grade level. Nevertheless, more than a decade of research has demonstrated that most online education materials pertaining to orthopaedic surgery do not meet these recommendations. The repeated evidence of this limited progress underscores that unaddressed barriers exist to improving readability, such as the added time and cost associated with writing easily readable materials that cover complex topics. Freely available artificial intelligence (AI) platforms might facilitate the conversion of patient-education materials at scale, but to our knowledge, this has not been evaluated in orthopaedic surgery. Questions/purposes:(1) Can a freely available AI dialogue platform rewrite orthopaedic patient education materials to reduce the required reading skill level from the high-school level to the sixth-grade level (which is approximately the median reading level in the United States)? (2) Were the converted materials accurate, and did they retain sufficient content detail to be informative as education materials for patients? Methods:Descriptions of lumbar disc herniation, scoliosis, and spinal stenosis, as well as TKA and THA, were identified from educational materials published online by orthopaedic surgery specialty organizations and leading orthopaedic institutions. The descriptions were entered into an AI dialogue platform with the prompt "translate to fifth-grade reading level" to convert each group of text at or below the sixth-grade reading level. The fifth-grade reading level was selected to account for potential variation in how readability is defined by the AI platform, given that there are several widely used preexisting methods for defining readability levels. The Flesch Reading Ease score and Flesch-Kincaid grade level were determined for each description before and after AI conversion. The time to convert was also recorded. Each education material and its respective conversion was reviewed for factual inaccuracies, and each conversion was reviewed for its retention of sufficient detail for intended use as a patient education document. Results:As presented to the public, the current descriptions of herniated lumbar disc, scoliosis, and stenosis had median (range) Flesch-Kincaid grade levels of 9.5 (9.1 to 10.5), 12.6 (10.8 to 15), and 10.9 (8 to 13.6), respectively. After conversion by the AI dialogue platform, the median Flesch-Kincaid grade level scores for herniated lumbar disc, scoliosis, and stenosis were 5.0 (3.3 to 8.2), 5.6 (4.1 to 7.3), and 6.9 (5 to 7.8), respectively. Similarly, descriptions of TKA and THA improved from 12.0 (11.2 to 13.5) to 6.3 (5.8 to 7.6) and from 11.6 (9.5 to 12.6) to 6.1 (5.4 to 7.1), respectively. The Flesch Reading Ease scores followed a similar trend. Seconds per sentence conversion was median 4.5 (3.3 to 4.9) and 4.5 (3.5 to 4.8) for spine conditions and arthroplasty, respectively. Evaluation of the materials that were converted for ease of reading still provided a sufficient level of nuance for patient education, and no factual errors or inaccuracies were identified. Conclusion:<br />We found that a freely available AI dialogue platform can improve the reading accessibility of orthopaedic surgery online patient education materials to recommended levels quickly and effectively. Professional organizations and practices should determine whether their patient education materials exceed current recommended reading levels by using widely available measurement tools, and then apply an AI dialogue platform to facilitate converting their materials to more accessible levels if needed. Additional research is needed to determine whether this technology can be applied to additional materials meant to inform patients, such as surgical consent documents or postoperative instructions, and whether the methods presented here are applicable to non-English language materials.
引用
收藏
页码:2260 / 2267
页数:8
相关论文
共 50 条
  • [41] Readability and Suitability of Online Patient Education Materials for Glaucoma
    Martin, Cole A.
    Khan, Saima
    Lee, Rachel
    Do, Anna T.
    Sridhar, Jayanth
    Crowell, Eric L.
    Bowden, Eileen C.
    OPHTHALMOLOGY GLAUCOMA, 2022, 5 (05): : 525 - 530
  • [42] Readability of Online Patient Education Materials for Peripheral Neuropathy
    Agarwal, Nitin
    Hansberry, David
    NEUROLOGY, 2012, 78
  • [43] Readability Assessment of Online Urology Patient Education Materials
    Colaco, Marc
    Svider, Peter F.
    Agarwal, Nitin
    Eloy, Jean Anderson
    Jackson, Imani M.
    JOURNAL OF UROLOGY, 2013, 189 (03): : 1048 - 1052
  • [44] Can Artificial Intelligence Improve the Management of Pneumonia
    Chumbita, Mariana
    Cilloniz, Catia
    Puerta-Alcalde, Pedro
    Moreno-Garcia, Estela
    Sanjuan, Gemma
    Garcia-Pouton, Nicole
    Soriano, Alex
    Torres, Antoni
    Garcia-Vidal, Carolina
    JOURNAL OF CLINICAL MEDICINE, 2020, 9 (01)
  • [45] Readability and Suitability of Online Uveitis Patient Education Materials
    Khan, Saima
    Moon, Jared
    Martin, Cole A. A.
    Bowden, Eileen
    Chen, Judy
    Tsui, Edmund
    Crowell, Eric
    OCULAR IMMUNOLOGY AND INFLAMMATION, 2024, 32 (07) : 1175 - 1179
  • [46] How can Artificial Intelligence improve contouring
    Van Elmpt, W.
    RADIOTHERAPY AND ONCOLOGY, 2020, 152 : S129 - S129
  • [47] Readability of Patient Education Materials Available at the Point of Care
    Lauren M. Stossel
    Nora Segar
    Peter Gliatto
    Robert Fallar
    Reena Karani
    Journal of General Internal Medicine, 2012, 27 : 1165 - 1170
  • [48] Can artificial intelligence improve cancer treatments?
    Derbal, Youcef
    HEALTH INFORMATICS JOURNAL, 2022, 28 (02)
  • [49] A quality and readability comparison of artificial intelligence and popular health website education materials for common hand surgery procedures
    Pohl, Nicholas B.
    Derector, Evan
    Rivlin, Michael
    Bachoura, Abdo
    Tosti, Rick
    Kachooei, Amir R.
    Beredjiklian, Pedro K.
    Fletcher, Daniel J.
    HAND SURGERY & REHABILITATION, 2024, 43 (03):
  • [50] Enhancing online cataract surgery patient education materials through artificial intelligence
    Li, Gavin
    Lin, Michael X.
    Cui, David
    Mathews, Priya M.
    Akpek, Esen K.
    CANADIAN JOURNAL OF OPHTHALMOLOGY-JOURNAL CANADIEN D OPHTALMOLOGIE, 2025, 60 (02): : e197 - e202