Dynamic Measurement in Health Professions Education: Rationale, Application, and Possibilities

被引:8
作者
Dumas, Denis [1 ]
McNeish, Daniel [2 ]
Schreiber-Gregory, Deanna [3 ]
Durning, Steven J. [4 ]
Torre, Dario M. [4 ]
机构
[1] Univ Denver, Res Methods & Informat Sci, Denver, CO USA
[2] Arizona State Univ, Quantitat Psychol, Phoenix, AZ USA
[3] Uniformed Serv Univ Hlth Sci, Bethesda, MD 20814 USA
[4] Uniformed Serv Univ Hlth Sci, Med, Bethesda, MD 20814 USA
关键词
NONLINEAR GROWTH-MODELS; EVALUATION FORM; VALIDITY;
D O I
10.1097/ACM.0000000000002729
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Dynamic measurement modeling (DMM) is a psychometric paradigm that uses longitudinal data to estimate individual students' growth in measured skills over the course of an educational program (i.e., growth scores). DMM represents a more formal way of assessing learning progress across the health professions education continuum. In this article, the authors provide justification for this approach in health professions education and demonstrate its proof-of-concept use with three time points of United States Medical Licensing Examination Step exams to generate growth scores for 454 current and recent medical learners. The authors demonstrate that learners vary substantially on their growth scores, and those growth scores exhibit psychometric reliability. In addition, growth scores significantly and positively correlated with indicators of medical learner readiness (e.g., undergraduate grade point average and Medical College Admission Test scores). These growth scores were also capable of significantly and positively correlating with future ratings of clinical competencies during internship as assessed through a survey sent to their program directors at the end of the first postgraduate year (e.g., patient care, interpersonal skills). These preliminary findings of reliability and validity for DMM growth scores provide initial evidence for further investigation into the suitability of a dynamic measurement paradigm in health professions education.
引用
收藏
页码:1323 / 1328
页数:6
相关论文
共 18 条
[1]   Progress testing: critical analysis and suggested practices [J].
Albanese, Mark ;
Case, Susan M. .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2016, 21 (01) :221-234
[2]   Learning Potential in high IQ children: The contribution of dynamic assessment to the identification of gifted children [J].
Dolores Calero, M. ;
Belen, Garcia-Martin M. ;
Auxiliadora Robles, M. .
LEARNING AND INDIVIDUAL DIFFERENCES, 2011, 21 (02) :176-181
[3]   Development and Initial Validation of a Program Director's Evaluation Form for Medical School Graduates [J].
Dong, Ting ;
Durning, Steven J. ;
Gilliland, William R. ;
Swygert, Kimberly A. ;
Artino, Anthony R., Jr. .
MILITARY MEDICINE, 2015, 180 (04) :97-103
[4]   Using Relational Reasoning Strategies to Help Improve Clinical Reasoning Practice [J].
Dumas, Denis ;
Torre, Dario M. ;
Durning, Steven J. .
ACADEMIC MEDICINE, 2018, 93 (05) :709-714
[5]   Increasing the Consequential Validity of Reading Assessment Using Dynamic Measurement Modeling: A Comment on Dumas and McNeish (2017) [J].
Dumas, Denis G. ;
McNeish, Daniel M. .
EDUCATIONAL RESEARCHER, 2018, 47 (09) :612-614
[6]   Dynamic Measurement Modeling: Using Nonlinear Growth Models to Estimate Student Learning Capacity [J].
Dumas, Denis G. ;
McNeish, Daniel M. .
EDUCATIONAL RESEARCHER, 2017, 46 (06) :284-292
[7]   The feasibility, reliability, and validity of a program director's (supervisor's) evaluation form for medical school graduates [J].
Durning, SJ ;
Pangaro, LN ;
Lawrence, LL ;
Waechter, D ;
McManigle, J ;
Jackson, JL .
ACADEMIC MEDICINE, 2005, 80 (10) :964-968
[8]   Functional neuroimaging correlates of thinking flexibility and knowledge structure in memory: Exploring the relationships between clinical reasoning and diagnostic thinking [J].
Durning, Steven J. ;
Costanzo, Michelle E. ;
Beckman, Thomas J. ;
Artino, Anthony R., Jr. ;
Roy, Michael J. ;
van der Vleuten, Cees ;
Holmboe, Eric S. ;
Lipner, Rebecca S. ;
Schuwirth, Lambert .
MEDICAL TEACHER, 2016, 38 (06) :570-577
[9]   Progress testing internationally [J].
Freeman, Adrian ;
Van der Vleuten, Cees ;
Nouns, Zineb ;
Ricketts, Chris .
MEDICAL TEACHER, 2010, 32 (06) :451-455
[10]   Relationships among subcomponents of the USMLE step 2 clinical skills examination, the step 1, and the step 2 clinical knowledge examinations [J].
Harik, Polina ;
Clauser, Brian E. ;
Grabovsky, Irina ;
Margolis, Melissa J. ;
Dillon, Gerard F. ;
Boulet, John R. .
ACADEMIC MEDICINE, 2006, 81 (10) :S21-S24