The Construct and Criterion Validity of the Mini-CEX: A Meta-Analysis of the Published Research

被引:43
作者
Al Ansari, Ahmed [1 ]
Ali, Syeda Kauser [2 ]
Donnon, Tyrone [3 ]
机构
[1] Bahrain Def Force Hosp, Fac Med, Dept Surg, Riffa, Bahrain
[2] Aga Khan Univ, Fac Med, Dept Family Med, Karachi, Pakistan
[3] Univ Calgary, Fac Med, Med Educ & Res Unit, Dept Community Hlth Sci, Calgary, AB T2N 4N1, Canada
关键词
CLINICAL-EVALUATION EXERCISE; RELIABILITY; SKILLS; FEASIBILITY; SATISFACTION; PERFORMANCE; RATINGS; MCEX;
D O I
10.1097/ACM.0b013e318280a953
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Purpose To conduct a meta-analysis of published studies to determine the construct and criterion validity of the mini-clinical evaluation exercise (mini-CEX) to measure clinical performance. Method The authors included all peer-reviewed studies published from 1995 to 2012 that reported the relationship between participants' performance on the mini-CEX and on other standardized academic and clinical performance measures. Moderator variables and performance and standardized exam measures were extracted and reviewed independently using a standardized coding protocol. Results Performance measures from 11 studies were identified. A random-effects model of weighted mean effect size differences (d) resulted in: (1) construct validity coefficients for the mini-CEX on the trainees' performance across different residency year levels ranging from d = 0.25 (95% confidence intervals [CCI]: 0.04-0.46) to d = 0.50 (95% CI: 0.31-0.70), and (2) concurrent validity coefficients for the mini-CEX based on personnel ratings ranging from d = 0.23 (95% CI: 0.04-0.50) to d = 0.50 (95% CI: 0.34-0.65). Also, a random-effects model of weighted correlation effect size differences (r) resulted in predictive validity coefficients for the mini-CEX on trainees' performance across different standardized measures ranging from r = 0.26 (95% CI: 0.16-0.35) to r = 0.85 (95% CI: 0.47-0.96). Conclusions The construct and criterion validity of the mini-CEX was supported by small to large effect size differences based on measures between trainees' achievement and clinical skills performance, indicating that it is an important instrument for the direct observation of trainees' clinical performance.
引用
收藏
页码:413 / 420
页数:8
相关论文
共 25 条
  • [1] Borenstein M., 2021, INTRO META ANAL, DOI DOI 10.1002/9780470743386
  • [2] Assessing the comparability of standardized patient and physician evaluations of clinical skills
    Boulet, JR
    McKinley, DW
    Norcini, JJ
    Whelan, GP
    [J]. ADVANCES IN HEALTH SCIENCES EDUCATION, 2002, 7 (02) : 85 - 97
  • [3] Cohen J., 1988, Statistical power analysis for the behavioral sciences, VSecond
  • [4] Internal structure of mini-CEX scores for internal medicine residents: factor analysis and generalizability
    Cook, David A.
    Beckman, Thomas J.
    Mandrekar, Jayawant N.
    Pankratz, V. Shane
    [J]. ADVANCES IN HEALTH SCIENCES EDUCATION, 2010, 15 (05) : 633 - 645
  • [5] Cooper H., 2009, The handbook of research synthesis and Metaanalysis, V2nd, DOI DOI 10.7758/9781610448864
  • [6] Validity, reliability, feasibility and satisfaction of the Mini-Clinical Evaluation Exercise (Mini-CEX) for cardiology residency training
    De Lima, Alberto Alves
    Barrero, Carlos
    Baratta, Sergio
    Costa, Yanina Castillo
    Bortman, Guillermo
    Carabajales, Justo
    Conde, Diego
    Galli, Amanda
    Degrange, Graciela
    Van der Vleuten, Cees
    [J]. MEDICAL TEACHER, 2007, 29 (08) : 785 - 790
  • [7] METAANALYSIS IN CLINICAL-TRIALS
    DERSIMONIAN, R
    LAIRD, N
    [J]. CONTROLLED CLINICAL TRIALS, 1986, 7 (03): : 177 - 188
  • [8] Assessing the reliability and validity of the mini-clinical evaluation exercise for internal medicine residency training
    Durning, SJ
    Cation, LJ
    Markert, RJ
    Pangaro, LN
    [J]. ACADEMIC MEDICINE, 2002, 77 (09) : 900 - 904
  • [9] In-training evaluation during an internal medicine clerkship
    Hatala, R
    Norman, GR
    [J]. ACADEMIC MEDICINE, 1999, 74 (10) : S118 - S120
  • [10] Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination
    Hatala, Rose
    Ainslie, Martha
    Kassen, Barry O.
    Mackie, Iain
    Roberts, J. Mark
    [J]. MEDICAL EDUCATION, 2006, 40 (10) : 950 - 956