Rater errors in a clinical skills assessment of medical students

被引:63
作者
Iramaneerat, Cherdsak [1 ]
Yudkowsky, Rachel [1 ]
机构
[1] Univ Illinois, Chicago, IL 60607 USA
关键词
rater errors; many-faceted Rasch measurement; OSCE; standardized patients; medical students; clinical skills;
D O I
10.1177/0163278707304040
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
The authors used a many-faceted Rasch measurement model to analyze rating data from a clinical skills assessment of 173 fourth-year medical students to investigate four types of rater errors: leniency, inconsistency, the halo effect, and restriction of range. Students performed six clinical tasks with 6 standardized patients (SPs) selected from a pool of 17 SPs. SPs rated the performance of each student in six skills: history taking, physical examination, interpersonal skills, communication technique, counseling skills, and physical examination etiquette. SPs showed statistically significant differences in their rating severity, indicating rater leniency error. Four SPs exhibited rating inconsistency. Four SPs restricted their ratings in high categories. Only 1 SP exhibited a halo effect. Administrators of objective structured clinical examinations should be vigilant for various types of rater errors and attempt to reduce or eliminate those errors to improve the validity of inferences based on objective structured clinical examination scores.
引用
收藏
页码:266 / 283
页数:18
相关论文
共 50 条
[31]   Teaching and assessment of clinical diagnostic reasoning in medical students [J].
Gilkes, Lucy ;
Kealley, Narelle ;
Frayne, Jacqueline .
MEDICAL TEACHER, 2022, 44 (06) :650-656
[32]   A CRASH course in procedural skills improves medical students' self-assessment of proficiency, confidence, and anxiety [J].
Stewart, Robyn A. ;
Hauge, Linnea S. ;
Stewart, Robert D. ;
Rosen, Robert L. ;
Charnot-Katsikas, Angella ;
Prinz, Richard A. .
AMERICAN JOURNAL OF SURGERY, 2007, 193 (06) :771-773
[33]   Communication Skills in Standardized-Patient Assessment of Final-Year Medical Students: A Psychometric Study [J].
Gretchen Guiton ;
Carol S. Hodgson ;
Ginett Delandshere ;
Luann Wilkerson .
Advances in Health Sciences Education, 2004, 9 :179-187
[34]   The Assessment of Undergraduate Medical Students' Satisfaction Levels With the Objective Structured Clinical Examination [J].
Khorashad, Ahmad Khosravi ;
Salari, Somayyeh ;
Baharvandat, Humain ;
Hejazi, Sepideh ;
Lari, Shiva M. ;
Salari, Maasoomeh ;
Mazloomi, Maryam ;
Lari, Shahrzad M. .
IRANIAN RED CRESCENT MEDICAL JOURNAL, 2014, 16 (08)
[35]   Communication skills in standardized-patient assessment of final-year medical students: A psychometric study [J].
Guiton, G ;
Hodgson, CS ;
Delandshere, G ;
Wilkerson, L .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2004, 9 (03) :179-187
[36]   The impact of introducing the Korean Medical Licensing Examination clinical skills assessment medical education [J].
Park, Hoon-Ki .
JOURNAL OF THE KOREAN MEDICAL ASSOCIATION, 2012, 55 (02) :116-123
[37]   Medical Students' Readiness for Prescription Communication Skills Training: A Needs Assessment Study [J].
Shivaraju, Padmanabha Thiruganahalli ;
Manchukonda, Ravi Shankar ;
Lokanathan, Tejaswi H. ;
Kshamaa, Haradanahalli G. .
CUREUS JOURNAL OF MEDICAL SCIENCE, 2024, 16 (09)
[38]   Improving the Clinical Skills Performance of Graduating Medical Students Using "WISE OnCall," a Multimedia Educational Module [J].
Szyld, Demian ;
Uquillas, Kristen ;
Green, Brad R. ;
Yavner, Steven D. ;
Song, Hyuksoon ;
Nick, Michael W. ;
Ng, Grace M. ;
Pusic, Martin V. ;
Riles, Thomas S. ;
Kalet, Adina .
SIMULATION IN HEALTHCARE-JOURNAL OF THE SOCIETY FOR SIMULATION IN HEALTHCARE, 2017, 12 (06) :385-392
[39]   Differences in expectations of passing standards in communication skills for pre-clinical and clinical medical students [J].
Park, Yoon Soo ;
Kamin, Carol ;
Son, Daisuke ;
Kim, Ginnie ;
Yudkowsky, Rachel .
PATIENT EDUCATION AND COUNSELING, 2019, 102 (02) :301-308
[40]   Application of blended learning approach in clinical skills to stimulate active learning attitudes and improve clinical practice among medical students [J].
Gong, Jie ;
Ruan, Manzhen ;
Yang, Wen ;
Peng, Miao ;
Wang, Zhen ;
Ouyang, Lichen ;
Yang, Guangyao .
PEERJ, 2021, 9