Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR

被引：45

作者：

Walji, Muhammad F. ^{[1
]}

Kalenderian, Elsbeth ^{[2
]}

Piotrowski, Mark ^{[1
]}

Tran, Duong ^{[1
]}

Kookal, Krishna K. ^{[1
]}

Tokede, Oluwabunmi ^{[2
]}

White, Joel M. ^{[3
]}

Vaderhobli, Ram ^{[3
]}

Ramoni, Rachel ^{[4
]}

Stark, Paul C. ^{[5
]}

Kimmes, Nicole S. ^{[6
]}

Lagerweij, Maxim

Patel, Vimla L. ^{[7
]}

机构：

[1] Univ Texas Hlth Sci Ctr Houston, Houston, TX 77054 USA

[2] Harvard Univ, Sch Dent Med, Cambridge, MA 02138 USA

[3] Univ Calif San Francisco, San Francisco, CA 94143 USA

[4] Harvard Univ, Sch Med, Cambridge, MA 02138 USA

[5] Tufts Univ, Medford, MA USA

[6] Creighton Univ, Omaha, NE 68178 USA

[7] New York Acad Med, New York, NY USA

来源：

INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS | 2014年 / 83卷 / 05期

关键词：

EHR; Usability; Human factors; Methodology; HEALTH INFORMATION-SYSTEMS; ELECTRONIC MEDICAL RECORDS; UNINTENDED CONSEQUENCES; ORDER SETS; TECHNOLOGY; CARE; PHYSICIANS; EFFICIENCY; IMPACT; ERRORS;

D O I：

10.1016/j.ijmedinf.2014.01.010

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Objective: To comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR: user testing, semi-structured interviews and surveys. Materials and methods: Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N = 32), semi-structured interviews (N = 36), and surveys (N = 35). Results: The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods. Discussion: Multiple evaluation methods provide a comprehensive approach to identifying EHR usability challenges and specific problems. The three methods were found to be complementary, and thus each can provide unique insights for software enhancement. Interview and survey methods were found not to be sufficient by themselves, but when used in conjunction with the user testing method, they provided a comprehensive evaluation of the EHR. Conclusion: We recommend using a multi-method approach when testing the usability of health information technology because it provides a more comprehensive picture of usability challenges. (c) 2014 Elsevier Ireland Ltd. All rights reserved.

引用

页码：361 / 367

页数：7

共 50 条

[1] Assessment of Usability Evaluation Methods
Riihiaho, Sirpa
ECCE 2009 - EUROPEAN CONFERENCE ON COGNITIVE ERGONOMICS: DESIGNING BEYOND THE PRODUCT - UNDERSTANDING ACTIVITY AND USER EXPERIENCE IN UBIQUITOUS ENVIRONMENTS, 2009, 258 : 434 - 437
[2] Are two methods better than one?
Van Emden, HF
INTERNATIONAL JOURNAL OF PEST MANAGEMENT, 1999, 45 (01) : 1 - 2
[3] Dogmas in the assessment of usability evaluation methods
Hornbaek, Kasper
BEHAVIOUR & INFORMATION TECHNOLOGY, 2010, 29 (01) : 97 - 111
[4] Development of Methods for Usability Evaluations of EHR Systems
Lilholt, Lars H.
Pedersen, Signe S.
Madsen, Inge
Nielsen, Per H.
Boye, Niels
Andersen, Stig K.
Nohr, Christian
UBIQUITY: TECHNOLOGIES FOR BETTER HEALTH IN AGING SOCIETIES, 2006, 124 : 341 - +
[5] A comparative analysis of heuristic and usability evaluation methods
Simeral, EJ
Branaghan, RJ
SOCIETY FOR TECHNICAL COMMUNICATION 44TH ANNUAL CONFERENCE, 1997 PROCEEDINGS, 1997, : 307 - 309
[6] Comparative Study of Heuristic Evaluation and Usability Testing Methods
Thyvalikakath, Thankam Paul
Monaco, Valerie
Thambuganipalle, Himabindu
Schleyer, Titus
ADVANCES IN INFORMATION TECHNOLOGY AND COMMUNICATION IN HEALTH, 2009, 143 : 322 - +
[7] Usability evaluation methods
Scapin, DL
Berns, T
BEHAVIOUR & INFORMATION TECHNOLOGY, 1997, 16 (4-5) : 185 - 187
[8] A Comparative Analysis of Usability Evaluation Methods on Their Versatility in the Face of Diversified User Input Methods
Ishikawa, Daiju
Kato, Takashi
Kita, Chigusa
HCI INTERNATIONAL 2015 - POSTERS' EXTENDED ABSTRACTS, PT I, 2015, 528 : 32 - 37
[9] Usability in a medical technology context assessment of methods for usability evaluation of medical equipment
Liljegren, E
INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2006, 36 (04) : 345 - 352
[10] DECEASED DONOR TYPING - TWO METHODS ARE BETTER THAN ONE
dela Cruz, Thea Rica
Dames, Charlyn
Pagaduan, Louise
Kong, Device
Rajalingam, Raja
HUMAN IMMUNOLOGY, 2019, 80 : 87 - 87

← 1 2 3 4 5 →