Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour

被引:36
作者
de Jonge, Laury P. J. W. M. [1 ]
Timmerman, Angelique A. [1 ]
Govaerts, Marjan J. B. [2 ]
Muris, Jean W. M. [1 ]
Muijtjens, Arno M. M. [2 ]
Kramer, Anneke W. M. [3 ]
van der Vleuten, Cees P. M. [2 ]
机构
[1] Maastricht Univ, Dept Family Med, FHML, POB 616, NL-6200 MD Maastricht, Netherlands
[2] Maastricht Univ, Dept Educ Res & Dev, FHML, Maastricht, Netherlands
[3] Leiden Univ, Dept Family Med, Leiden, Netherlands
关键词
Assessment perceptions; Assessor variability; Competency based medical education; Q methodology; Workplace-based assessment; IN-TRAINING ASSESSMENT; MINI-CEX SCORES; MEDICAL-EDUCATION; Q METHODOLOGY; CLINICAL-PRACTICE; RATING BEHAVIOR; BLACK-BOX; FEEDBACK; COMPETENCE; ATTITUDES;
D O I
10.1007/s10459-017-9760-7
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments-rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to imply that variable behaviours during performance assessment of both assessors and learners may well reflect their respective beliefs and perspectives towards WBA. We therefore performed a Q methodological study to explore perspectives underlying stakeholders' behaviours in WBA in a postgraduate medical training program. Five different perspectives on performance assessment were extracted: Agency, Mutuality, Objectivity, Adaptivity and Accountability. These perspectives reflect both differences and similarities in stakeholder perceptions and preferences regarding the utility of WBA. In comparing and contrasting the various perspectives, we identified two key areas of disagreement, specifically 'the locus of regulation of learning' (i.e., self-regulated versus externally regulated learning) and 'the extent to which assessment should be standardised' (i.e., tailored versus standardised assessment). Differing perspectives may variously affect stakeholders' acceptance, use-and, consequently, the effectiveness-of assessment programmes. Continuous interaction between all stakeholders is essential to monitor, adapt and improve assessment practices and to stimulate the development of a shared mental model. Better understanding of underlying stakeholder perspectives could be an important step in bridging the gap between psychometric and socio-constructivist approaches in WBA.
引用
收藏
页码:1213 / 1243
页数:31
相关论文
共 69 条
  • [1] Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior
    Ajzen, I
    [J]. JOURNAL OF APPLIED SOCIAL PSYCHOLOGY, 2002, 32 (04) : 665 - 683
  • [2] PREDICTION OF GOAL-DIRECTED BEHAVIOR - ATTITUDES, INTENTIONS, AND PERCEIVED BEHAVIORAL-CONTROL
    AJZEN, I
    MADDEN, TJ
    [J]. JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 1986, 22 (05) : 453 - 474
  • [3] State of the science in health professional education: effective feedback
    Archer, Julian C.
    [J]. MEDICAL EDUCATION, 2010, 44 (01) : 101 - 108
  • [4] Expertise in performance assessment: assessors' perspectives
    Berendonk, Christoph
    Stalmeijer, Renee E.
    Schuwirth, Lambert W. T.
    [J]. ADVANCES IN HEALTH SCIENCES EDUCATION, 2013, 18 (04) : 559 - 571
  • [5] Programmatic assessment of competency-based workplace learning: when theory meets practice
    Bok, Harold G. J.
    Teunissen, Pim W.
    Favier, Robert P.
    Rietbroek, Nancy J.
    Theyse, Lars F. H.
    Brommer, Harold
    Haarhuis, Jan C. M.
    van Beukelen, Peter
    van der Vleuten, Cees P. M.
    Jaarsma, Debbie A. D. C.
    [J]. BMC MEDICAL EDUCATION, 2013, 13
  • [6] Q Technique, Method, and Methodology: Comments on Stentor Danielson's Article
    Brown, Steven R.
    [J]. FIELD METHODS, 2009, 21 (03) : 238 - 241
  • [7] FEEDBACK AND SELF-REGULATED LEARNING - A THEORETICAL SYNTHESIS
    BUTLER, DL
    WINNE, PH
    [J]. REVIEW OF EDUCATIONAL RESEARCH, 1995, 65 (03) : 245 - 281
  • [8] Cilliers F., 2015, HLTH BEHAV THEORIES, P141
  • [9] Internal structure of mini-CEX scores for internal medicine residents: factor analysis and generalizability
    Cook, David A.
    Beckman, Thomas J.
    Mandrekar, Jayawant N.
    Pankratz, V. Shane
    [J]. ADVANCES IN HEALTH SCIENCES EDUCATION, 2010, 15 (05) : 633 - 645
  • [10] Effect of Rater Training on Reliability and Accuracy of Mini-CEX Scores: A Randomized, Controlled Trial
    Cook, David A.
    Dupras, Denise M.
    Beckman, Thomas J.
    Thomas, Kris G.
    Pankratz, V. Shane
    [J]. JOURNAL OF GENERAL INTERNAL MEDICINE, 2009, 24 (01) : 74 - 79