The Validity of Scores From the New MCAT Exam in Predicting Student Performance: Results From a Multisite Study

被引:42
作者
Busche, Kevin [1 ,2 ]
Elks, Martha L. [3 ,4 ]
Hanson, Joshua T. [5 ,6 ]
Jackson-Williams, Loretta [7 ,8 ]
Manuel, R. Stephen [9 ,10 ]
Parsons, Wanda L. [11 ,12 ]
Wofsy, David [13 ,14 ]
Yuan, Kun [15 ]
机构
[1] Univ Calgary, Cumming Sch Med, Med Educ, Calgary, AB, Canada
[2] Univ Calgary, Cumming Sch Med, Clin Neurosci, Calgary, AB, Canada
[3] Morehouse Sch Med, Educ Affairs, Atlanta, GA 30310 USA
[4] Morehouse Sch Med, Med Educ & Med, Atlanta, GA 30310 USA
[5] Univ Texas Hlth San Antonio, Student Affairs, Joe R & Teresa Lozano Long Sch Med, San Antonio, TX USA
[6] Univ Texas Hlth San Antonio, Med, Joe R & Teresa Lozano Long Sch Med, San Antonio, TX USA
[7] Univ Mississippi, Med Ctr, Sch Med, Med Educ, Jackson, MS 39216 USA
[8] Univ Mississippi, Med Ctr, Sch Med, Emergency Med, Jackson, MS 39216 USA
[9] Univ Mississippi, Sch Med, Med Sch Admiss, Jackson, MS USA
[10] Univ Mississippi, Sch Med, Family Med, Jackson, MS USA
[11] Mem Univ Newfoundland, Fac Med, Family Med, St John, NF, Canada
[12] Mem Univ Newfoundland, Fac Med, Admiss, St John, NF, Canada
[13] Univ Calif San Francisco, Sch Med, Admiss, San Francisco, CA USA
[14] Univ Calif San Francisco, Sch Med, Med, San Francisco, CA USA
[15] Assoc Amer Med Coll, Med Coll Admiss Test Res, Washington, DC 20001 USA
关键词
COLLEGE ADMISSION TEST; MEDICAL-SCHOOL; METAANALYSIS;
D O I
10.1097/ACM.0000000000002942
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Purpose The new Medical College Admission Test (MCAT) was introduced in April 2015. This report presents findings from the first study of the validity of scores from the new MCAT exam in predicting student performance in the first year of medical school (M1). Method The authors analyzed data from the national population of 2016 matriculants with scores from the new MCAT exam (N = 7,970) and the sample of 2016 matriculants (N = 955) from 16 medical schools who volunteered to participate in the validity research. They examined correlations of students' MCAT total scores and total undergraduate grade point averages (UGPAs), alone and together, with their summative performance in M1, and the success rate of students with different MCAT scores in their on-time progression to the second year of medical school (M2). They assessed whether MCAT scores provided comparable prediction of performance in M1 by students' race/ethnicity, socioeconomic background, and gender. Results Correlations of MCAT scores with summative performance in M1 ranged from medium to large. Although MCAT scores and UGPAs provided similar prediction of performance in M1, using both metrics provided better prediction than either alone. Additionally, students with a wide range of MCAT scores progressed to M2 on time. Finally, MCAT scores provided comparable prediction of performance in M1 for students from different sociodemographic backgrounds. Conclusions This study provides early evidence that scores from the new MCAT exam predict student performance in M1. Future research will examine the validity of MCAT scores in predicting performance in later years.
引用
收藏
页码:387 / 395
页数:9
相关论文
共 31 条
  • [1] AERA APA NCME, 2014, Standards for educational and psychological testing, DOI DOI 10.1037/14855-004
  • [2] [Anonymous], 2018, US MCAT DAT 2019 MED
  • [3] [Anonymous], STAT NEW AAMC DEF UN
  • [4] Anthony LC., PREDICTIVE VALIDITY
  • [5] Association of American Medical Colleges, 2017, 2018 AMCAS APPL GUID
  • [6] Association of American Medical Colleges, 2018, TABL B 3 TOT US MED
  • [7] Association of American Medical Colleges, 2017, US MCAT DAT 2018 MED
  • [8] A POWER PRIMER
    COHEN, J
    [J]. PSYCHOLOGICAL BULLETIN, 1992, 112 (01) : 155 - 159
  • [9] Cohen J., 1988, Statistical power analysis for the behavioral sciences, V2nd
  • [10] Do Racial and Ethnic Group Differences in Performance on the MCAT Exam Reflect Test Bias?
    Davis, Dwight
    Dorsey, J. Kevin
    Franks, Ronald D.
    Sackett, Paul R.
    Searcy, Cynthia A.
    Zhao, Xiaohui
    [J]. ACADEMIC MEDICINE, 2013, 88 (05) : 593 - 602