Assessment of neurosurgical resident milestone evaluation reporting and feedback processes

被引:7
作者
Clarke, Michelle J. [1 ]
Frimannsdottir, Katrin [2 ]
机构
[1] Mayo Clin, Dept Neurol Surg, Rochester, MN USA
[2] Minist Educ Culture & Sci, Dept Educ, Reykjavik, Iceland
关键词
neurosurgery; education; feedback; milestones; assessment; interview; summative evaluation; matrix framework method; SELF-ASSESSMENT; FACULTY; PERFORMANCE; COMPETENCE; PERCEPTIONS; MEDICINE;
D O I
10.3171/2022.1.FOCUS21734
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
OBJECTIVE Structured performance evaluations are important for the professional development and personal growth of resident learners. This process is formalized by the Accreditation Council for Graduate Medical Education milestones assessment system. The primary aim of this study was to understand the current feedback delivery mechanism by exploring the culture of feedback, the mechanics of delivery, and the evaluation of the feedback itself. METHODS Face-to-face interviews were conducted with 10 neurosurgery residents exploring their perceptions of summative feedback. Coded data were analyzed qualitatively for overriding themes using the matrix framework method. A priori themes of definition of feedback, feedback delivery, and impact of feedback were combined with de novo themes discovered during analysis. RESULTS Trainees prioritized formative over summative feedback. Summative and milestone feedback were criticized as being vague, misaligned with practice, and often perceived as erroneous. Barriers to implementation of summative feedback included perceived veracity of feedback, high interrater variability, and the inconstant adoption of a developmental progression model. Gender bias was noted in degree of feedback provided and language used. CONCLUSIONS Trainee perception of feedback provided multiple areas of improvement. This paper can serve as a baseline to study improvements in the milestone feedback process and optimize learning. https://thejns.org/doi/abs/10.3171/2022.1.FOCUS21734
引用
收藏
页数:7
相关论文
共 39 条
[21]   Rater-Based Assessments as Social Judgments: Rethinking the Etiology of Rater Errors [J].
Gingerich, Andrea ;
Regehr, Glenn ;
Eva, Kevin W. .
ACADEMIC MEDICINE, 2011, 86 (10) :S2-S8
[22]   The Hidden Value of Narrative Comments for Assessment: A Quantitative Reliability Analysis of Qualitative Data [J].
Ginsburg, Shiphra ;
van der Vleuten, Cees P. M. ;
Eva, Kevin W. .
ACADEMIC MEDICINE, 2017, 92 (11) :1617-1621
[23]   Reading between the lines: faculty interpretations of narrative evaluation comments [J].
Ginsburg, Shiphra ;
Regehr, Glenn ;
Lingard, Lorelei ;
Eva, Kevin W. .
MEDICAL EDUCATION, 2015, 49 (03) :296-306
[24]   A National Study of Longitudinal Consistency in ACGME Milestone Ratings by Clinical Competency Committees: Exploring an Aspect of Validity in the Assessment of Residents' Competence [J].
Hamstra, Stanley J. ;
Yamazaki, Kenji ;
Barton, Melissa A. ;
Santen, Sally A. ;
Beeson, Michael S. ;
Holmboe, Eric S. .
ACADEMIC MEDICINE, 2019, 94 (10) :1522-1531
[25]   Code Saturation Versus Meaning Saturation: How Many Interviews Are Enough? [J].
Hennink, Monique M. ;
Kaiser, Bonnie N. ;
Marconi, Vincent C. .
QUALITATIVE HEALTH RESEARCH, 2017, 27 (04) :591-608
[26]  
Holt Kathleen D, 2010, J Grad Med Educ, V2, P649, DOI 10.4300/JGME-02-04-30
[27]   The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory [J].
Kluger, AN ;
DeNisi, A .
PSYCHOLOGICAL BULLETIN, 1996, 119 (02) :254-284
[28]   Faculty staff perceptions of feedback to residents after direct observation of clinical skills [J].
Kogan, Jennifer R. ;
Conforti, Lisa N. ;
Bernabeo, Elizabeth C. ;
Durning, Steven J. ;
Hauer, Karen E. ;
Holmboe, Eric S. .
MEDICAL EDUCATION, 2012, 46 (02) :201-215
[29]  
Mueller Anna S, 2017, J Grad Med Educ, V9, P577, DOI 10.4300/JGME-D-17-00126.1
[30]   The Next GME Accreditation System - Rationale and Benefits [J].
Nasca, Thomas J. ;
Philibert, Ingrid ;
Brigham, Timothy ;
Flynn, Timothy C. .
NEW ENGLAND JOURNAL OF MEDICINE, 2012, 366 (11) :1051-1056