Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour

被引:36
作者
de Jonge, Laury P. J. W. M. [1 ]
Timmerman, Angelique A. [1 ]
Govaerts, Marjan J. B. [2 ]
Muris, Jean W. M. [1 ]
Muijtjens, Arno M. M. [2 ]
Kramer, Anneke W. M. [3 ]
van der Vleuten, Cees P. M. [2 ]
机构
[1] Maastricht Univ, Dept Family Med, FHML, POB 616, NL-6200 MD Maastricht, Netherlands
[2] Maastricht Univ, Dept Educ Res & Dev, FHML, Maastricht, Netherlands
[3] Leiden Univ, Dept Family Med, Leiden, Netherlands
关键词
Assessment perceptions; Assessor variability; Competency based medical education; Q methodology; Workplace-based assessment; IN-TRAINING ASSESSMENT; MINI-CEX SCORES; MEDICAL-EDUCATION; Q METHODOLOGY; CLINICAL-PRACTICE; RATING BEHAVIOR; BLACK-BOX; FEEDBACK; COMPETENCE; ATTITUDES;
D O I
10.1007/s10459-017-9760-7
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments-rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to imply that variable behaviours during performance assessment of both assessors and learners may well reflect their respective beliefs and perspectives towards WBA. We therefore performed a Q methodological study to explore perspectives underlying stakeholders' behaviours in WBA in a postgraduate medical training program. Five different perspectives on performance assessment were extracted: Agency, Mutuality, Objectivity, Adaptivity and Accountability. These perspectives reflect both differences and similarities in stakeholder perceptions and preferences regarding the utility of WBA. In comparing and contrasting the various perspectives, we identified two key areas of disagreement, specifically 'the locus of regulation of learning' (i.e., self-regulated versus externally regulated learning) and 'the extent to which assessment should be standardised' (i.e., tailored versus standardised assessment). Differing perspectives may variously affect stakeholders' acceptance, use-and, consequently, the effectiveness-of assessment programmes. Continuous interaction between all stakeholders is essential to monitor, adapt and improve assessment practices and to stimulate the development of a shared mental model. Better understanding of underlying stakeholder perspectives could be an important step in bridging the gap between psychometric and socio-constructivist approaches in WBA.
引用
收藏
页码:1213 / 1243
页数:31
相关论文
共 69 条
  • [11] Exploring attitudes: the case for Q methodology
    Cross, RM
    [J]. HEALTH EDUCATION RESEARCH, 2005, 20 (02) : 206 - 213
  • [12] The Academic Half-Day redesigned: Improving generalism, promoting CanMEDS and developing self-directed learners
    Di Genova, Tanya
    Valentino, Pamela L.
    Gosselin, Richard
    Bhanji, Farhan
    [J]. PAEDIATRICS & CHILD HEALTH, 2015, 20 (01) : 30 - 34
  • [13] Assessment and feedback to facilitate self-directed learning in clinical practice of Midwifery students
    Embo, Mieke P. C.
    Driessen, Erik W.
    Valcke, Martin
    Van der Vleuten, Cees P. M.
    [J]. MEDICAL TEACHER, 2010, 32 (07) : E263 - E269
  • [14] Scylla or Charybdis? Can we navigate between objectification and judgement in assessment?
    Eva, Kevin W.
    Hodges, Brian D.
    [J]. MEDICAL EDUCATION, 2012, 46 (09) : 914 - 919
  • [15] Perceived Effects of Innovations in Postgraduate Medical Education: A Q Study Focusing on Workplace-Based Assessment
    Fokkema, Joanne P. I.
    Scheele, Fedde
    Westerman, Michiel
    van Exel, Job
    Scherpbier, Albert J. J. A.
    van der Vleuten, Cees P. M.
    Dorr, P. Joep
    Teunissen, Pim W.
    [J]. ACADEMIC MEDICINE, 2014, 89 (09) : 1259 - 1266
  • [16] Frank J. R., 2015, PHYS COMPETENCY FRAM, VIII, DOI [10.13140/2.1.5039.4402, DOI 10.13140/2.1.5039.4402]
  • [17] It's in the mind of the beholder: The impact of stereotypic associations on category-based and individuating impression formation
    Gawronski, B
    Ehrenberg, K
    Banse, R
    Zukova, J
    Klauer, KC
    [J]. JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2003, 39 (01) : 16 - 30
  • [18] Seeing the 'black box' differently: assessor cognition from three research perspectives
    Gingerich, Andrea
    Kogan, Jennifer
    Yeates, Peter
    Govaerts, Marjan
    Holmboe, Eric
    [J]. MEDICAL EDUCATION, 2014, 48 (11) : 1055 - 1068
  • [19] Rater-Based Assessments as Social Judgments: Rethinking the Etiology of Rater Errors
    Gingerich, Andrea
    Regehr, Glenn
    Eva, Kevin W.
    [J]. ACADEMIC MEDICINE, 2011, 86 (10) : S2 - S8
  • [20] Validity in work-based assessment: expanding our horizons
    Govaerts, Marjan
    van der Vleuten, Cees P. M.
    [J]. MEDICAL EDUCATION, 2013, 47 (12) : 1164 - 1174