Development and validation of clinical performance assessment in simulated medical emergencies: An observational study

被引：11

作者：

Erdogan A. ^{[1
,2
,3
,4
]}

Dong Y. ^{[1
,4
]}

Chen X. ^{[1
,5
]}

Schmickl C. ^{[1
,4
,6
]}

Sevilla Berrios R.A. ^{[1
,4
]}

Garcia Arguello L.Y. ^{[1
,4
]}

Kashyap R. ^{[1
,4
]}

Kilickaya O. ^{[1
,4
,7
]}

Pickering B. ^{[1
,2
,4
]}

Gajic O. ^{[1
,4
]}

O'Horo J.C. ^{[1
,4
]}

机构：

[1] Mayo Clinic, Department of Medicine, Rochester, MN

[2] Mayo Clinic, Department of Anesthesiology, Rochester, MN

[3] Suleyman Demirel University, Department of Anesthesiology and Reanimation, Isparta

[4] METRIC group, Mayo Clinic, Rochester, MN

[5] Qilu Hospital of Shandong University, Department of Critical Care Medicine, Shandong

[6] Boston University Medical Center, Department of Internal Medicine, Boston, MA

[7] Gulhane Medical Faculty, Department of Anesthesiology and Reanimation, Ankara

来源：

BMC Emergency Medicine | / 16卷 / 1期

关键词：

Critical Care; Clinical Decision Support; Fluid Bolus; Simulation Center; Crew Resource Management;

D O I：

10.1186/s12873-015-0066-x

中图分类号：

学科分类号：

摘要：

Background: Critical illness is a time-sensitive process which requires practitioners to process vast quantities of data and make decisions rapidly. We have developed a tool, the Checklist for Early Recognition and Treatment of Acute Illness (CERTAIN), aimed at enhancing care delivery in such situations. To determine the efficacy of CERTAIN and similar cognitive aids, we developed rubric for evaluating provider performance in a simulated medical resuscitation environments. Methods: We recruited 18 clinicians with current valid ACLS certification for evaluation in three simulated medical scenarios designed to mimic typical medical decompensation events routinely experienced in clinical care. Subjects were stratified as experienced or novice based on prior critical care training. A checklist of critical actions was designed using face validity for each scenario to evaluate task completion and performance. Simulation sessions were video recorded and scored by two independent raters. Construct validity was assessed under the assumption that experienced clinicians should perform better than novice clinicians on each task. Reliability was assessed as percentage agreement, kappa statistics and Bland-Altman plots as appropriate. Results: Eleven experts and seven novices completed evaluation. The overall agreement on common checklist item completion was 84.8%. The overall model achieved face validity and was consistent with our construct, with experienced clinicians trending towards better performance compared to novices for accuracy and speed of task completion. Conclusions: A standardized video assessment tool has potential to provide a valid and reliable method to assess 12 performances of clinicians facing simulated medical emergencies. © 2016 Erdogan et al.

引用

共 26 条

[1]

O K., B B., O G., Structured Approach to Early Recognition and Treatment of Acute Critical Illness In: Annual Update in Intensive Care and Emergency Medicine 2014, pp. 689-703, (2014)

[2]

Flin R., Maran N., Identifying and training non-technical skills for teams in acute medicine, Qual Saf Health Care, 13, pp. i80-i84, (2004)

[3]

Fletcher G., Flin R., McGeorge P., Glavin R., Maran N., Patey R., Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system, Br J Anaesth, 90, 5, pp. 580-588, (2003)

[4]

Malec J.F., Torsher L.C., Dunn W.F., Wiegmann D.A., Arnold J.J., Brown D.A., Et al., The Mayo high performance teamwork scale: Reliability and validity for evaluating key crew resource management skills, Simul Healthc, 2, 1, pp. 4-10, (2007)

[5]

Cooper S., O'Carroll J., Jenkin A., Badger B., Collaborative practices in unscheduled emergency care: role and impact of the emergency care practitioner--quantitative findings, Emerg Med J, 24, 9, pp. 630-633, (2007)

[6]

Walker S., Brett S., McKay A., Lambden S., Vincent C., Sevdalis N., Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): development and validation, Resuscitation, 82, 7, pp. 835-844, (2011)

[7]

Vukoja M., Kashyap R., Gavrilovic S., Dong Y., Kilickaya O., Gajic O., Checklist for early recognition and treatment of acute illness: International collaboration to improve critical care practice, World J Crit Care Med, 4, 1, pp. 55-61, (2015)

[8]

Sevilla Berrios R., O'Horo J.C., Schmickl C., Erdogan A., Chen X., Arguello L.G., Et al., 264: Prompting with Electronic Checklist Improves Clinician Performance in Medical Emergencies: A High Fidelity Simulation Center Study, Crit Care Med, 42, 12, (2014)

[9]

Sevilla Berrios R., O'Horo J.C., Schmickl C., Erdogan A., Chen X., Garcia Arguello L., Et al., Evaluation of clinician performance in the assessment and management of acutely decompensated patients with and without electronic checklist: a simulation study, Intensive Care Med, 40, (2014)

[10]

Eagle D.M., Coltvet G., Farley D., The Mayo Clinic, Multidisciplinary Simulation Center, J Surg Educ, 67, 6, pp. 470-472, (2010)

← 1 2 3 →