Standardized Comparison of Voice-Based Information and Documentation Systems to Established Systems in Intensive Care: Crossover Study

被引:0
作者
Peine, Arne [1 ,5 ]
Gronholz, Maike [2 ]
Seidl-Rathkopf, Katharina [2 ]
Wolfram, Thomas [2 ]
Hallawa, Ahmed [1 ]
Reitz, Annika [2 ]
Celi, Leo Anthony [3 ,4 ]
Marx, Gernot [1 ]
Martin, Lukas [1 ,2 ]
机构
[1] Univ Hosp RWTH Aachen, Dept Intens Care Med & Intermediate Care, Pauwelsstr 30, D-52070 Aachen, Germany
[2] Clinom Grp GmbH, Aachen, Germany
[3] Harvard MIT Div Hlth Sci Technol, Lab Computat Physiol, Cambridge, MA USA
[4] Beth Israel Deaconess Med Ctr, Boston, MA USA
[5] Univ Hosp RWTH Aachen, Dept Intens & Intermediate Care Med, Pauwelsstr 30, D-52074 Aachen, Germany
关键词
artificial intelligence; documentation; ICU; intensive care medicine; speech-recognition; user perception; workload; SPEECH RECOGNITION; IMPACT; RECORD; WORK; BURNOUT; MOTION; NURSE; TIME;
D O I
10.2196/44773
中图分类号
R-058 [];
学科分类号
摘要
Background: The medical teams in intensive care units (ICUs) spend increasing amounts of time at computer systems for data processing, input, and interpretation purposes. As each patient creates about 1000 data points per hour, the available information is abundant, making the interpretation difficult and time-consuming. This data flood leads to a decrease in time for evidence-based, patient-centered care. Information systems, such as patient data management systems (PDMSs), are increasingly used at ICUs. However, they often create new challenges arising from the increasing documentation burden.Objective: New concepts, such as artificial intelligence (AI)-based assistant systems, are hence introduced to the workflow to cope with these challenges. However, there is a lack of standardized, published metrics in order to compare the various data input and management systems in the ICU setting. The objective of this study is to compare established documentation and retrieval processes with newer methods, such as PDMSs and voice information and documentation systems (VIDSs). Methods: In this crossover study, we compare traditional, paper-based documentation systems with PDMSs and newer AI-based VIDSs in terms of performance (required time), accuracy, mental workload, and user experience in an intensive care setting. Performance is assessed on a set of 6 standardized, typical ICU tasks, ranging from documentation to medical interpretation.Results: A total of 60 ICU-experienced medical professionals participated in the study. The VIDS showed a statistically significant advantage compared to the other 2 systems. The tasks were completed significantly faster with the VIDS than with the PDMS (1-tailed t(59)=12.48; Cohen d=1.61; P<.001) or paper documentation (t(59)=20.41; Cohen d=2.63; P<.001). Significantly fewer errors were made with VIDS than with the PDMS (t(59)=3.45; Cohen d=0.45; P=.03) and paper-based documentation (t(59)=11.2; Cohen d=1.45; P<.001). The analysis of the mental workload of VIDS and PDMS showed no statistically significant difference (P=.06). However, the analysis of subjective user perception showed a statistically significant perceived benefit of the VIDS compared to the PDMS (P<.001) and paper documentation (P<.001).Conclusions: The results of this study show that the VIDS reduced error rate, documentation time, and mental workload regarding the set of 6 standardized typical ICU tasks. In conclusion, this indicates that AI-based systems such as the VIDS tested in this study have the potential to reduce this workload and improve evidence-based and safe patient care.
引用
收藏
页数:15
相关论文
共 50 条
[1]   The effect of two different electronic health record user interfaces on intensive care provider task load, errors of cognition, and performance [J].
Ahmed, Adil ;
Chandra, Subhash ;
Herasevich, Vitaly ;
Gajic, Ognjen ;
Pickering, Brian W. .
CRITICAL CARE MEDICINE, 2011, 39 (07) :1626-1634
[2]  
[Anonymous], 2015, IntelliSpace critical care and anesthesia: release H technical data sheet
[3]   Impact of a Critical Care Clinical Information System on Interruption Rates During Intensive Care Nurse and Physician Documentation Tasks [J].
Ballermanna, Mark A. ;
Shaw, Nicola T. ;
Arbeau, Kelly J. ;
Mayes, Damon C. ;
Gibney, R. T. Noel .
MEDINFO 2010, PTS I AND II, 2010, 160 :274-278
[4]   The impact of electronic health record systems on clinical documentation times: A systematic review [J].
Baumann, Lisa Ann ;
Baker, Jannah ;
Elshaug, Adam G. .
HEALTH POLICY, 2018, 122 (08) :827-836
[5]  
Beecken WD, 2020, Think Tanks im Gesundheitswesen: Deutsche Denkfabriken und ihre Positionen zur Zukunft der Gesundheit, P29
[6]   Physician use of speech recognition versus typing in clinical documentation: A controlled observational study [J].
Blackley, Suzanne, V ;
Schubert, Valerie D. ;
Goss, Foster R. ;
Al Assad, Wasim ;
Garabedian, Pamela M. ;
Zhou, Li .
INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2020, 141
[7]   MULTIPLE SIGNIFICANCE TESTS - THE BONFERRONI METHOD .10. [J].
BLAND, JM ;
ALTMAN, DG .
BRITISH MEDICAL JOURNAL, 1995, 310 (6973) :170-170
[8]   Estimating Time Physicians and Other Health Care Workers Spend with Patients in an Intensive Care Unit Using a Sensor Network [J].
Butler, Rachel ;
Monsalve, Mauricio ;
Thomas, Geb W. ;
Herman, Ted ;
Segre, Alberto M. ;
Polgreen, Philip M. ;
Suneja, Manish .
AMERICAN JOURNAL OF MEDICINE, 2018, 131 (08) :972.e9-972.e15
[9]   Impact of electronic health record technology on the work and workflow of physicians in the intensive care unit [J].
Carayon, Pascale ;
Wetterneck, Tosha B. ;
Alyousef, Bashar ;
Brown, Roger L. ;
Cartmill, Randi S. ;
McGuire, Kerry ;
Hoonakker, Peter L. T. ;
Slagle, Jason ;
Van Roy, Kara S. ;
Walker, James M. ;
Weinger, Matthew B. ;
Xie, Anping ;
Wood, Kenneth E. .
INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2015, 84 (08) :578-594
[10]  
Castellanos I, 2013, ANAESTHESIST, V62, P887, DOI 10.1007/s00101-013-2239-x