EVALUATING EVALUATION - ASSESSMENT OF THE AMERICAN BOARD OF INTERNAL MEDICINE RESIDENT EVALUATION FORM

被引:60
作者
THOMPSON, WG
LIPKIN, M
GILBERT, DA
GUZZO, RA
ROBERSON, L
机构
[1] The Division of Primary Care, Department of Medicine, New York University School of Medicine
[2] Department of Psychology, New York University, New York, New York
[3] Department of Psychology, University of Maryland, College Park, Maryland
[4] University of Tennessee College of Medicine, Knoxville Unit, Knoxville, Tennessee, 37920
关键词
education; medical; graduate; educational measurement; internship and residency;
D O I
10.1007/BF02600537
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
The American Board of Internal Medicine suggests use of a standard form to rate residents on nine dimensions (such as clinical judgment and overall clinical competence) on a scale of 1 to 9. The authors examined the psychometric evidence for reliability and validity of 1,039 ratings of 85 residents by 135 attendings in a single internal medicine residency program. Of these ratings, 95.6% were from 6 to 9. Factor analysis revealed that high correlations among the nine dimensions (r ranged from 0.72 to 0.92) resulted from a single global factor accounting for 86% of the variance. The study also examined whether the form reliably distinguishes among residents scoring between 6 and 9. Agreement among attendings rating the same individual was weak (average reliability=0.64, by the method of James). The rating method fails to discriminate dimensions of clinical care and has low reliability for distinguishing among competent residents. © 1990, Society of General Internal Medicine. All rights reserved.
引用
收藏
页码:214 / 217
页数:4
相关论文
共 13 条
  • [1] The role of the attending physician in evaluating residents, (1987)
  • [2] James L.R., Demaree R.G., Wolf G., Estimating within-group interrater reliability with and without response bias, J Applied Psychol, 69, pp. 85-98, (1984)
  • [3] Murphy K.R., Balzer W.K., Rater errors and rating accuracy, J Applied Psychol, 74, (1989)
  • [4] Bernardin H.J., Beatty R.W., Performance appraisal: assessing human behavior at work, (1984)
  • [5] Nunnally J.C., Psychometric theory, (1967)
  • [6] Levine H.G., McGuire C.H., Rating habitual performance in graduate medical education, J Med Educ, 46, (1971)
  • [7] Clinical competence in internal medicine, Ann Intern Med, 90, (1979)
  • [8] Banks C.G., Roberson L., Performance appraisers as test developers, Acad Management Rev, 10, (1985)
  • [9] Wigton R.S., Factors important in the evaluation of clinical performance of internal medicine residents, J Med Educ, 55, (1980)
  • [10] Quarrick E.A., Sloop E.W., A method for identifying the criteria of good performance in a medical clerkship program, J Med Educ, 47, (1972)