When, where, who, what, and why? The five Ws of workflow analysis for implementing an AI decision support tool at the intensive care

被引:0
作者
de Hond, Anne A. H. [1 ,2 ,3 ]
Vosslamber, Suzanne
Lange, Sanne [4 ]
Engel, Friso [4 ]
Lindhout, Mette [4 ]
Noorlag, Puck [4 ]
Steyerberg, Ewout W. [1 ,2 ]
Cina, Giovanni [5 ,7 ]
Arbous, M. Sesmu [6 ]
机构
[1] Leiden Univ, Med Ctr, Dept Neurosurg, Albinusdreef 2, NL-2333 ZA Leiden, Netherlands
[2] Leiden Univ, Med Ctr, Dept Biomed Data Sci, Albinusdreef 2, NL-2300 RC Leiden, Netherlands
[3] Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Heidelberglaan 100, NL-3584 CX Utrecht, Netherlands
[4] Pacmed, Stadhouderskade 55, NL-1072 AB Amsterdam, Netherlands
[5] Leiden Univ, Med Ctr, Dept Intens Care Med, Albinusdreef 2, NL-2300 RC Leiden, Netherlands
[6] Univ Amsterdam, Inst Log Language & Computat, Sci Pk 107, NL-1098 XG Amsterdam, Netherlands
[7] Amsterdam Univ Med Ctr, Dept Med Informat, Meibergdreef 9, NL-1105 AZ Amsterdam, Netherlands
来源
HUMAN FACTORS IN HEALTHCARE | 2025年 / 7卷
关键词
critical care workflow; workflow analyses; observational study; artificial intelligence; implementation; decision support tool; DATA SATURATION; IMPACT; ICU;
D O I
10.1016/j.hfh.2025.100095
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background: There has been a surge in the development of clinical artificial intelligence (AI) decision support tools. Yet, few of these tools have been implemented into clinical practice. A lack of understanding of the clinical workflow may hamper implementation. Objective: This study develops and illustrates a method for the analysis of a clinical decision-making workflow at the ICU to facilitate the safe and efficient implementation of an AI decision support tool. Material & Methods: A method is proposed that uses observations to study the context in which clinical decisions occur (physical workflow), and the key factors influencing decision-making (cognitive workflow). This approach provides a comprehensive understanding of the 'when', 'where', 'who', 'what', and 'why' of the decision-making process. The method was applied to a use case involving the decision to discharge a patient from the ICU to the regular ward. Results: The results showed that the proposed methodology effectively provided a thorough understanding of the physical workflow, in terms of time, location, actors, and materials for receiving decision support with AI. Additionally, it identified the key factors influencing the cognitive workflow. Conclusion: We presented a method for the workflow analysis of clinical decision-making at the ICU before AI implementation. A thorough understanding of the clinical workflow is essential for implementation of an AI decision support tool. This method forms a blueprint and further validation is needed for other clinical contexts.
引用
收藏
页数:7
相关论文
共 42 条
  • [1] Guidelines for Human-AI Interaction
    Amershi, Saleema
    Weld, Dan
    Vorvoreanu, Mihaela
    Fourney, Adam
    Nushi, Besmira
    Collisson, Penny
    Suh, Jina
    Iqbal, Shamsi
    Bennett, Paul N.
    Inkpen, Kori
    Teevan, Jaime
    Kikin-Gil, Ruth
    Horvitz, Eric
    [J]. CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
  • [2] Bassford C., 2019, Health Services and Delivery Research. Developing an intervention around referral and admissions to intensive care: a mixed-methods study
  • [3] A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy
    Beede, Emma
    Baylor, Elizabeth
    Hersch, Fred
    Iurchenko, Anna
    Wilcox, Lauren
    Ruamviboonsuk, Paisan
    Vardoulakis, Laura M.
    [J]. PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,
  • [4] Admission and discharge of critically ill patients
    Capuzzo, Maurizia
    Moreno, Rui P.
    Alvisi, Raffaele
    [J]. CURRENT OPINION IN CRITICAL CARE, 2010, 16 (05) : 499 - 504
  • [5] Impact of electronic health record technology on the work and workflow of physicians in the intensive care unit
    Carayon, Pascale
    Wetterneck, Tosha B.
    Alyousef, Bashar
    Brown, Roger L.
    Cartmill, Randi S.
    McGuire, Kerry
    Hoonakker, Peter L. T.
    Slagle, Jason
    Van Roy, Kara S.
    Walker, James M.
    Weinger, Matthew B.
    Xie, Anping
    Wood, Kenneth E.
    [J]. INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2015, 84 (08) : 578 - 594
  • [6] Cheng C H, 2003, AMIA Annu Symp Proc, P150
  • [7] Davenport Thomas, 2019, Future Healthc J, V6, P94, DOI 10.7861/futurehosp.6-2-94
  • [8] Predicting Readmission or Death After Discharge From the ICU: External Validation and Retraining of a Machine Learning Model
    de Hond, Anne A. H.
    Kant, Ilse M. J.
    Fornasa, Mattia
    Cina, Giovanni
    Elbers, Paul W. G.
    Thoral, Patrick J. J.
    Arbous, M. Sesmu
    Steyerberg, Ewout W. W.
    [J]. CRITICAL CARE MEDICINE, 2023, 51 (02) : 291 - 300
  • [9] Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review
    de Hond, Anne A. H.
    Leeuwenberg, Artuur M.
    Hooft, Lotty
    Kant, Ilse M. J.
    Nijman, Steven W. J.
    van Os, Hendrikus J. A.
    Aardoom, Jiska J.
    Debray, Thomas P. A.
    Schuit, Ewoud
    van Smeden, Maarten
    Reitsma, Johannes B.
    Steyerberg, Ewout W.
    Chavannes, Niels H.
    Moons, Karel G. M.
    [J]. NPJ DIGITAL MEDICINE, 2022, 5 (01)
  • [10] Critical care physician cognitive task analysis: an exploratory study
    Fackler, James C.
    Watts, Charles
    Grome, Anna
    Miller, Thomas
    Crandall, Beth
    Pronovost, Peter
    [J]. CRITICAL CARE, 2009, 13 (02):