Assessing performance of an Electronic Health Record (EHR) using Cognitive Task Analysis

被引:53
作者
Saitwal, Himali [1 ]
Feng, Xuan [2 ]
Walji, Muhammad [1 ]
Patel, Vimla [1 ]
Zhang, Jiajie [1 ]
机构
[1] Univ Texas Houston, Hlth Sci Ctr, Sch Hlth Informat Sci, Houston, TX 77030 USA
[2] Arizona State Univ, Dept Biomed Informat, Phoenix, AZ USA
关键词
Electronic Health Records; Cognitive Task Analysis; Distributed cognition; UFuRT; GOMS; KLM;
D O I
10.1016/j.ijmedinf.2010.04.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Many Electronic Health Record (EHR) systems fail to provide user-friendly interfaces due to the lack of systematic consideration of human-centered computing issues. Such interfaces can be improved to provide easy to use, easy to learn, and error-resistant EHR systems to the users. Objective: To evaluate the usability of an EHR system and suggest areas of improvement in the user interface. Methods: The user interface of the AHLTA (Armed Forces Health Longitudinal Technology Application) was analyzed using the Cognitive Task Analysis (CTA) method called GOMS (Goals, Operators, Methods, and Selection rules) and an associated technique called KLM (Keystroke Level Model). The GOMS method was used to evaluate the AHLTA user interface by classifying each step of a given task into Mental (Internal) or Physical (External) operators. This analysis was performed by two analysts independently and the inter-rater reliability was computed to verify the reliability of the GOMS method. Further evaluation was performed using KLM to estimate the execution time required to perform the given task through application of its standard set of operators. Results: The results are based on the analysis of 14 prototypical tasks performed by AHLTA users. The results show that on average a user needs to go through 106 steps to complete a task. To perform all 14 tasks, they would spend about 22 min (independent of system response time) for data entry, of which 11 min are spent on more effortful mental operators. The inter-rater reliability analysis performed for all 14 taskswas 0.8 (kappa), indicating good reliability of the method. Conclusion: This paper empirically reveals and identifies the following finding related to the performance of AHLTA: (1) large number of average total steps to complete common tasks, (2) high average execution time and (3) large percentage of mental operators. The user interface can be improved by reducing (a) the total number of steps and (b) the percentage of mental effort, required for the tasks. (C) 2010 Elsevier Ireland Ltd. All rights reserved.
引用
收藏
页码:501 / 506
页数:6
相关论文
共 50 条
  • [31] Workarounds in Electronic Health Record Systems and the Revised Sociotechnical Electronic Health Record Workaround Analysis Framework: Scoping Review
    Blijleven, Vincent
    Hoxha, Florian
    Jaspers, Monique
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2022, 24 (03)
  • [32] Implementation of a Behavioral Economics Electronic Health Record (BE-EHR) Module to Reduce Overtreatment of Diabetes in Older Adults
    Belli, Hayley M.
    Chokshi, Sara K.
    Hegde, Roshini
    Troxel, Andrea B.
    Blecker, Saul
    Testa, Paul A.
    Anderman, Judd
    Wong, Christina
    Mann, Devin M.
    JOURNAL OF GENERAL INTERNAL MEDICINE, 2020, 35 (11) : 3254 - 3261
  • [33] Implementation of a Behavioral Economics Electronic Health Record (BE-EHR) Module to Reduce Overtreatment of Diabetes in Older Adults
    Hayley M. Belli
    Sara K. Chokshi
    Roshini Hegde
    Andrea B. Troxel
    Saul Blecker
    Paul A. Testa
    Judd Anderman
    Christina Wong
    Devin M. Mann
    Journal of General Internal Medicine, 2020, 35 : 3254 - 3261
  • [34] Assessing an Electronic Health Record research platform for identification of clinical trial participants
    Laaksonen, Niina
    Varjonen, Juha-Matti
    Blomster, Minna
    Palomaki, Antti
    Vasankari, Tuija
    Airaksinen, Juhani
    Huupponen, Risto
    Scheinin, Mika
    Blomster, Juuso
    CONTEMPORARY CLINICAL TRIALS COMMUNICATIONS, 2021, 21
  • [35] Association of Electronic Health Record Vendors With Hospital Financial and Quality Performance: Retrospective Data Analysis
    Beauvais, Bradley
    Kruse, Clemens Scott
    Fulton, Lawrence
    Shanmugam, Ramalingam
    Ramamonjiarivelo, Zo
    Brooks, Matthew
    JOURNAL OF MEDICAL INTERNET RESEARCH, 2021, 23 (04)
  • [36] Using the electronic health record for assessment of health insurance in community health centers
    Hatch, Brigit
    Tillotson, Carrie
    Angier, Heather
    Marino, Miguel
    Hoopes, Megan
    Huguet, Nathalie
    DeVoe, Jennifer
    JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2016, 23 (05) : 984 - 990
  • [37] Applying cognitive task analysis to health services research
    Graham, Laura A.
    Gray, Caroline
    Wagner, Todd H.
    Illarmo, Samantha
    Hawn, Mary T.
    Wren, Sherry M.
    Iannuzzi, James
    Harris, Alex H. S.
    HEALTH SERVICES RESEARCH, 2023, 58 (02) : 415 - 422
  • [38] Electronic health record usability and workload changes over time for provider and nursing staff following transition to new EHR
    Lopez, Karen Dunn
    Chin, Chieh-Li
    Azevedo, Renato Ferreira Leitao
    Kaushik, Varsha
    Roy, Bidisha
    Schuh, William
    Banks, Kayla
    Sousa, Vanessa
    Morrow, Daniel
    APPLIED ERGONOMICS, 2021, 93
  • [39] Harmonizing units and values of quantitative data elements in a very large nationally pooled electronic health record (EHR) dataset
    Bradwell, Katie R.
    Wooldridge, Jacob T.
    Amor, Benjamin
    Bennett, Tellen D.
    Anand, Adit
    Bremer, Carolyn
    Yoo, Yun Jae
    Qian, Zhenglong
    Johnson, Steven G.
    Pfaff, Emily R.
    Girvin, Andrew T.
    Manna, Amin
    Niehaus, Emily A.
    Hong, Stephanie S.
    Zhang, Xiaohan Tanner
    Zhu, Richard L.
    Bissell, Mark
    Qureshi, Nabeel
    Saltz, Joel
    Haendel, Melissa A.
    Chute, Christopher G.
    Lehmann, Harold P.
    Moffitt, Richard A.
    JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2022, 29 (07) : 1172 - 1182
  • [40] A Virtual Platform for Electronic Health Record (EHR) Education for Nursing Students: Moving from In-House Solutions to the Cloud
    Kushniruk, Andre W.
    Kuo, Mu-Hsing
    Parapini, Eric
    Borycki, Elizabeth M.
    NURSING INFORMATICS 2014: EAST MEETS WEST ESMART+, 2014, 201 : 48 - 54