A longitudinal study of self-assessment accuracy

被引:104
作者
Fitzgerald, JT [1 ]
White, CB [1 ]
Gruppen, LD [1 ]
机构
[1] Univ Michigan, Sch Med, Dept Med Educ, Towsley Ctr, Ann Arbor, MI 48109 USA
关键词
clinical competence; standards; education; medical; methods; educational measurement; longitudinal studies; reproducibility of results; self-concept;
D O I
10.1046/j.1365-2923.2003.01567.x
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Aim Although studies have examined medical students' ability to self-assess their performance, there are few longitudinal studies that document the stability of self-assessment accuracy over time. This study compares actual and estimated examination performance for three classes during their first 3 years of medical school. Methods Students assessed their performance on classroom examinations and objective structured clinical examination (OSCE) stations. Each self-assessment was then contrasted with their actual performance using idiographic (within-subject) methods to define three measures of self-assessment accuracy: bias (arithmetic differences of actual and estimated scores), deviation (absolute differences of actual and estimated scores), and covariation (correlation of actual and estimated scores). These measures were computed for four intervals over the course of 3 years. Multivariate analyses of variance and correlational analyses were used to evaluate the stability of these measures. Results Self-assessment accuracy measures were relatively stable over the first 2 years of medical school with a decease occurring in the third year. However, the correlational analyses indicated that the stability of self-assessment accuracy was comparable to the stability of actual performance over this same period. Conclusion The apparent decline in accuracy in the third year may reflect the transition from familiar classroom-based examinations to the substantially different clinical examination tasks of the third year OSCE. However, the stability of self-assessment accuracy compares favorably with the stability of actual performance over this period. These results suggest that self-assessment accuracy is a relatively stable individual characteristic that may be influenced by task familiarity.
引用
收藏
页码:645 / 649
页数:5
相关论文
共 50 条
[31]   Comparison Between Surgical Trainee Self-Assessment With Supervisor Scores in Technical and Nontechnical Skills to Identify Underperforming Trainees [J].
Pan, Tzong-Yang ;
Piscioneri, Frank ;
Owen, Cathy .
JOURNAL OF SURGICAL EDUCATION, 2023, 80 (09) :1311-1319
[32]   Student self-assessment of strengths and needed improvements during a family medicine clerkship [J].
Huang, William ;
Barning, Kenneth ;
Grigoryan, Larissa .
FAMILY MEDICINE AND COMMUNITY HEALTH, 2015, 3 (02) :62-68
[33]   Artificial Intelligence on the Exam Table: ChatGPT's Advancement in Urology Self-assessment [J].
Cadiente, Angelo ;
Chen, Jamie ;
Nguyen, Jennifer ;
Sadeghi-Nejad, Hossein ;
Billah, Mubashir .
UROLOGY PRACTICE, 2023, 10 (06) :521-523
[34]   Refining a self-assessment of informatics competency scale using Mokken scaling analysis [J].
Yoon, Sunmoo ;
Shaffer, Jonathan A. ;
Bakken, Suzanne .
JOURNAL OF INTERPROFESSIONAL CARE, 2015, 29 (06) :579-586
[35]   In-training assessment: qualitative study of effects on supervision and feedback in an undergraduate clinical rotation [J].
Daelmans, HEM ;
Overmeer, RM ;
Hem-Stokroos, HH ;
Scherpbier, AJJA ;
Stehouwer, CDA ;
Vleuten, CPM .
MEDICAL EDUCATION, 2006, 40 (01) :51-58
[36]   Structured Reflection with Self-assessment Rubrics: A Study Report on Dental Students Expression, Experience, and Perceptions about Reflective Practice [J].
Anbarasi, K. ;
Vijayaraghavan, P. V. ;
Latha, Ravichandran ;
Kandaswamy, Deivanayagam ;
Kannan, L. .
JOURNAL OF CLINICAL AND DIAGNOSTIC RESEARCH, 2019, 13 (04) :JC10-JC16
[37]   A Study of Surgical Residents' Self-Assessment of Open Surgery Skills Using Gap Analysis [J].
Thinggaard, Ebbe ;
Zetner, Diana Bregner ;
Fabrin, Anja ;
Christensen, John Brochorst ;
Konge, Lars .
SIMULATION IN HEALTHCARE-JOURNAL OF THE SOCIETY FOR SIMULATION IN HEALTHCARE, 2023, 18 (05) :305-311
[38]   What are the clinical skills levels of newly graduated physicians? Self-assessment study of an intended curriculum identified by a Delphi process [J].
Moercke, AM ;
Eika, B .
MEDICAL EDUCATION, 2002, 36 (05) :472-478
[39]   Improving Robot Proficiency Self-Assessment via Meta-Assessment [J].
Cao, Xuan ;
Crandall, Jacob W. ;
Goodrich, Michael A. .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (11) :7297-7303
[40]   On the Assessment and Self-Assessment in a Students Teamwork Based Course on Software Engineering [J].
Budimac, Zoran ;
Putnik, Zoran ;
Ivanovic, Mirjana ;
Bothe, Klaus ;
Schuetzler, Kay .
COMPUTER APPLICATIONS IN ENGINEERING EDUCATION, 2011, 19 (01) :1-9