Development of an objective scoring system for measurement of resident performance on the human patient simulator

被引:70
作者
Scavone, Barbara M. [1 ]
Sproviero, Michele T. [1 ]
McCarthy, Robert J. [1 ]
Wong, Cynthia A. [1 ]
Sullivan, John T. [1 ]
Siddall, Viva J. [1 ]
Wade, Leonard D. [1 ]
机构
[1] Northwestern Univ, Feinberg Sch Med, Dept Anesthesiol, Chicago, IL 60611 USA
关键词
D O I
10.1097/00000542-200608000-00008
中图分类号
R614 [麻醉学];
学科分类号
100217 ;
摘要
Background: The decrease in the percentage of patients having cesarean delivery during general anesthesia has led some educators to advocate the increased use of simulation-based training for this anesthetic. The authors developed a scoring system to measure resident performance of this anesthetic on the human patient simulator and subjected the system to tests of validity and reliability. Methods: A modified Delphi technique was used to achieve a consensus among several experts regarding a standardized scoring system for evaluating resident performance of general anesthesia for emergency cesarean delivery on the human patient simulator. Eight third-year and eight first-year anesthesiology residents performed the scenario and were videotaped and scored by four attending obstetric anesthesiologists. Results: Third-year residents scored an average of 150.5 points, whereas first-year residents scored an average of 128 points (P = 0.004). The scoring instrument demonstrated high interrater reliability with an intraclass correlation coefficient of 0.97 (95% confidence interval, 0.94-0.99) compared with the average score. Conclusions: The developed scoring tool to measure resident performance of general anesthesia for emergency cesarean delivery on the patient simulator seems both valid and reliable in the context in which it was tested. This scoring system may prove useful for future studies such as those investigating the effect of simulator training on objective assessment of resident performance.
引用
收藏
页码:260 / 266
页数:7
相关论文
共 16 条
[1]   Reliability and validity of a simulation-based acute care skills assessment for medical students and residents [J].
Boulet, JR ;
Murray, D ;
Kras, J ;
Woodhouse, J ;
McAllister, J ;
Ziv, A .
ANESTHESIOLOGY, 2003, 99 (06) :1270-1280
[2]   Obstetric anesthesia workforce survey - Twenty-year update [J].
Bucklin, BA ;
Hawkins, JL ;
Anderson, JR ;
Ullrich, FA .
ANESTHESIOLOGY, 2005, 103 (03) :645-653
[3]   Assessment instruments used during anaesthetic simulation: review of published studies [J].
Byrne, AJ ;
Greaves, JD .
BRITISH JOURNAL OF ANAESTHESIA, 2001, 86 (03) :445-450
[4]  
Clayton MJ, 1997, ED PSYCHOL, V17, P373, DOI [DOI 10.1080/0144341970170401, 10.1080/0144341970170401]
[5]   The validity of performance assessments using simulation [J].
Devitt, JH ;
Kurrek, MM ;
Cohen, MM ;
Cleave-Hogg, D .
ANESTHESIOLOGY, 2001, 95 (01) :36-42
[6]   Use of a high-fidelity simulator to develop testing of the technical performance of novice anaesthetists [J].
Forrest, FC ;
Taylor, MA ;
Postlethwaite, K ;
Aspinall, R .
BRITISH JOURNAL OF ANAESTHESIA, 2002, 88 (03) :338-344
[7]   Assessment of clinical performance during simulated crises using both technical and behavioral ratings [J].
Gaba, DM ;
Howard, SK ;
Flanagan, B ;
Smith, BE ;
Fish, KJ ;
Botney, R .
ANESTHESIOLOGY, 1998, 89 (01) :8-18
[8]   Anesthesia-related deaths during obstetric delivery in the United States, 1979-1990 [J].
Hawkins, JL ;
Koonin, LM ;
Palmer, SK ;
Gibbs, CP .
ANESTHESIOLOGY, 1997, 86 (02) :277-284
[9]   The demise of general anesthesia in obstetrics revisited: prescription for a cure [J].
Lipman, S ;
Carvalho, B ;
Brock-Utne, J .
INTERNATIONAL JOURNAL OF OBSTETRIC ANESTHESIA, 2005, 14 (01) :2-4
[10]  
Morgan PJ, 2000, MED EDUC, V34, P42