Distorted perceptions of competence and incompetence are more than regression effects

被引:15
作者
Albanese, M. [1 ]
Dottl, S. [1 ]
Mejicano, G. [1 ]
Zakowski, L. [1 ]
Seibert, C. [1 ]
Van Eyck, S. [1 ]
Prucha, C. [1 ]
机构
[1] Univ Wisconsin, Sch Med, Madison, WI 53726 USA
关键词
distorted perceptions of competence; life-long learning; regression effects; self-assessment;
D O I
10.1007/s10459-005-2400-7
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Students inaccurately assess their own skills, especially high- or low-performers on exams. This study assessed whether regression effects account for this observation. After completing the Infection and Immunity course final exam (IIF), second year medical students (N=143) estimated their performance on the IIF in terms of percent correct and percentile rank. Second year grade point averages (M2GPAs) were combined with the IIF results to form five subgroups: 1=true-low (lowest third on both IIF and M2GPA, 2=false-low (lowest third on IIF only), 3=middle (neither lowest nor highest third on IIF), 4=false-high (highest third on IIF only), 5=true-high (highest third on IIF and M2GPA). The false-low and false-high groups were considered more susceptible to regression effects due to likely group misclassification. Differences between self-assessment and actual performance within each group and between the five groups were used to estimate what portion of observed differences is due to general tendencies versus regression effects. Results found that students accurately assessed their percent correct, but inaccurately assessed their percentile rank. No statistically significant differences existed between the true and false-low subgroups nor the true- and false-high subgroups. Percentages of mean differences suggest that while regression effects resulted in 50-75% over/under-estimates of scores by students who were misclassified, when they were merged with the true-low/high groups, they do not account for more than 14% of low performer over-estimates of their performance and high performer under-estimates of their performance. Accurate percent correct assessments and distorted percentile rank assessments are challenges in using instructional methods dependent on student self-assessments of their learning needs. Identifying and helping students with distorted perceptions of their test performances may be a key issue in such instructional approaches.
引用
收藏
页码:267 / 278
页数:12
相关论文
共 8 条
[1]  
ALBANESE M, 2002, P 19 INT OTT C MED E
[2]  
ARNOLD L, 1985, J MED EDUC, V60, P21
[3]  
Cohen J., 1988, STAT POWER ANAL BEHA
[4]   How can I know what I don't know? Poor self assessment in a well-defined domain [J].
Eva, KW ;
Cunnington, JPW ;
Reiter, HI ;
Keane, DR ;
Norman, GR .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2004, 9 (03) :211-224
[5]   STUDENT SELF-ASSESSMENT IN HIGHER-EDUCATION - A METAANALYSIS [J].
FALCHIKOV, N ;
BOUD, D .
REVIEW OF EDUCATIONAL RESEARCH, 1989, 59 (04) :395-430
[6]   Difficulties in recognizing one's own incompetence: Novice physicians who are unskilled and unaware of it [J].
Hodges, B ;
Regehr, G ;
Martin, D .
ACADEMIC MEDICINE, 2001, 76 (10) :S87-S89
[7]   Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments [J].
Kruger, J ;
Dunning, D .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1999, 77 (06) :1121-1134
[8]   Measuring self-assessment: Current state of the art [J].
Ward, M ;
Gruppen, L ;
Regehr, G .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2002, 7 (01) :63-80