The reliability of resident self-evaluation of operative performance

被引:17
作者
Kendrick, Daniel E. [1 ]
Clark, Michael J. [2 ]
Fischer, Ilana [1 ]
Bohnen, Jordan D. [3 ]
Kim, Grace J. [1 ]
George, Brian C. [1 ]
机构
[1] Univ Michigan, Ctr Surg Training & Res, Dept Surg, 010-A193 North Campus Res Complex, Ann Arbor, MI 48109 USA
[2] Univ Michigan, Consulting Stat Comp & Analyt Res, 3550 Rackham,915 E Washington St, Ann Arbor, MI 48109 USA
[3] Harvard Med Sch, Massachusetts Gen Hosp, Dept Surg, White 506,55 Fruit St, Boston, MA 02114 USA
关键词
Resident education; Performance assessment; Operative evaluation; R PACKAGE; UNAWARE; SKILLS; PERCEPTIONS; COMPETENCE; ACCURACY;
D O I
10.1016/j.amjsurg.2020.11.054
中图分类号
R61 [外科手术学];
学科分类号
摘要
Background: Self-assessment is critical to professional self-regulation yet many trainees may not reliably self-evaluate. We examine the gap between resident and faculty perceptions of trainee operative performance and contributing factors. Methods: Surgery resident and faculty evaluations of trainee performance were collected from 14 academic institutions using smartphone-based performance assessments. Differences in resident/faculty ratings evaluating the same procedure were analyzed using descriptive statistics and Bayesian mixed models. Results: Of 7382 evaluations, 46% trainees and faculty performance ratings were discrepant (r = 0.47), with 80% residents rating themselves lower than faculty in those cases. This gap existed regardless of case complexity and widened as trainees gained experience. Trainees who overrated themselves had the lowest mean performance scores from faculty. Conclusion: Half of residents perceived their performance differently from faculty, and this difference widened for senior residents. Future focus should be to provide opportunity for trainees to improve skills to reliably assess themselves before graduation. (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页码:341 / 346
页数:6
相关论文
共 22 条
[1]  
ACGME Surgery Program Requirements, 2018, ACGME PROGRAM REQUIR
[2]   Resident Surgeons Underrate Their Laparoscopic Skills and Comfort Level When Compared With the Rating by Attending Surgeons [J].
Alameddine, Mitchell A. ;
Claflin, Jake ;
Scally, Christopher P. ;
Noble, David M. ;
Reames, Bradley N. ;
Englesbe, Michael J. ;
Wong, Sandra L. .
JOURNAL OF SURGICAL EDUCATION, 2015, 72 (06) :1240-1246
[3]  
[Anonymous], 2017, Med Sci Educ., DOI [10.1007/s40670-016-0363-3, DOI 10.1007/S40670-016-0363-3]
[4]  
Bohnen Jordan D, 2016, J Surg Educ, V73, pe118, DOI 10.1016/j.jsurg.2016.08.010
[5]  
Bürkner PC, 2018, R J, V10, P395
[6]   brms: An R Package for Bayesian Multilevel Models Using Stan [J].
Buerkner, Paul-Christian .
JOURNAL OF STATISTICAL SOFTWARE, 2017, 80 (01) :1-28
[7]   Skilled or unskilled, but still unaware of it: How perceptions of difficulty drive miscalibration in relative comparisons [J].
Burson, KA ;
Larrick, RP ;
Klayman, J .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 2006, 90 (01) :60-77
[8]   Comparing resident measurements to attending surgeon self-perceptions of surgical educators [J].
Claridge, JA ;
Calland, JF ;
Chandrasekhara, V ;
Young, JS ;
Sanfey, H ;
Schirmer, BD .
AMERICAN JOURNAL OF SURGERY, 2003, 185 (04) :323-327
[9]   Accuracy of physician self-assessment compared with observed measures of competence - A systematic review [J].
Davis, David A. ;
Mazmanian, Paul E. ;
Fordis, Michael ;
Van Harrison, R. ;
Thorpe, Kevin E. ;
Perrier, Laure .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2006, 296 (09) :1094-1102
[10]  
Dunning David, 2004, Psychol Sci Public Interest, V5, P69, DOI 10.1111/j.1529-1006.2004.00018.x