Are script concordance tests suitable for the assessment of undergraduate students? A multicenter comparative study

被引:7
作者
Aubart, F. Cohen [1 ]
Papo, T. [2 ]
Hertig, A. [3 ]
Renaud, M-C [4 ]
Steichen, O. [5 ]
Amoura, Z. [1 ]
Braun, M. [6 ]
Palombi, O. [7 ]
Duguet, A. [8 ]
Roux, D. [9 ,10 ]
机构
[1] Sorbonne Univ, Hop Pitie Salpetriere, AP HP, Serv Med Interne 2,Ctr Natl Reference Malad Syst, F-75013 Paris, France
[2] Univ Paris, Hop Bichat, AP HP, Dept Med Interne, F-75018 Paris, France
[3] Sorbonne Univ, Hop Pitie Salpetriere, AP HP, Serv Nephrol & Transplantat Renale, F-75013 Paris, France
[4] Sorbonne Univ, Fac Med, F-75013 Paris, France
[5] Sorbonne Univ, Hop Tenon, AP HP, Serv Med Interne, F-75020 Paris, France
[6] Univ Lorraine, Serv Neuroradiol, CHRU Nancy, F-54035 Nancy, France
[7] Univ Grenoble Alpes, Serv Neurochirurg, CHU Grenoble, F-38000 Grenoble, France
[8] Sorbonne Univ, Hop Pitie Salpetriere, AP HP, Serv Pneumol, F-75013 Paris, France
[9] Univ Paris, Hop Louis Mourier, AP HP, Serv Med Intens Reanimat, F-92700 Colombes, France
[10] IAME, INSERM, UMR 1137, F-75018 Paris, France
来源
REVUE DE MEDECINE INTERNE | 2021年 / 42卷 / 04期
关键词
Script concordance test; Internal medicine; Undergraduate students; Multiple-choice question; Certification; MEDICAL-STUDENTS; VALIDITY; CONSTRUCTION; UNCERTAINTY; CONTEXT;
D O I
10.1016/j.revmed.2020.11.001
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Introduction. - Script concordance tests (SCTs) have been developed to assess clinical reasoning in uncertain situations. Their reliability for the evaluation of undergraduate medical students has not been evaluated. Methods. - Twenty internal medicine SCT cases were implemented in undergraduate students of two programs. The results obtained on the SCTs were compared to those obtained by the same students on clinical-based classical multiple-choice questions (MCQs). Results. - A total of 551/883 students (62%) answered the SCTs. The mean aggregate score (based on a total 20 points) was 11.54 (3.29). The success rate and mean score for each question did not differ depending on the modal response but the discrimination rate did. The results obtained by the students on the SCT test correlated with their scores on the MCQtests. Among students, 446/517 (86%) considered the SCTs to be more difficult than classical MCQs, although the mean score did not differ between the SCT and MCQtests. Conclusion. - The use of SCTs is a feasible option for the evaluation of undergraduate students. The SCT scores correlated with those obtained on classical MCQtests. (C) 2020 Societe Nationale Francaise de Medecine Interne (SNFMI). Published by Elsevier Masson SAS. All rights reserved.
引用
收藏
页码:243 / 250
页数:8
相关论文
共 22 条
[1]   Scripts and clinical reasoning [J].
Charlin, Bernard ;
Boshuizen, Henny P. A. ;
Custers, Eugene J. ;
Feltovich, Paul J. .
MEDICAL EDUCATION, 2007, 41 (12) :1178-1184
[2]   Assessment of clinical reasoning in the context of uncertainty:: the effect of variability within the reference panel [J].
Charlin, Bernard ;
Gagnon, Robert ;
Pelletier, Jean ;
Coletti, Michel ;
Abi-Rizk, Grace ;
Nasr, Claudine ;
Sauve, Evelyne ;
van der Vleuten, Cees .
MEDICAL EDUCATION, 2006, 40 (09) :848-854
[3]   Medical Education and Cognitive Continuum Theory: An Alternative Perspective on Medical Problem Solving and Clinical Reasoning [J].
Custers, Eugene J. F. M. .
ACADEMIC MEDICINE, 2013, 88 (08) :1074-1080
[4]   How to construct and implement script concordance tests: insights from a systematic review [J].
Dory, Valerie ;
Gagnon, Robert ;
Vanpee, Dominique ;
Charlin, Bernard .
MEDICAL EDUCATION, 2012, 46 (06) :552-563
[5]   Summative assessment of 5th year medical students' clinical reasoning by script concordance test: requirements and challenges [J].
Duggan, Paul ;
Charlin, Bernard .
BMC MEDICAL EDUCATION, 2012, 12
[6]   Script concordance tests: Guidelines for construction [J].
Fournier, Jean Paul ;
Demeester, Anne ;
Charlin, Bernard .
BMC MEDICAL INFORMATICS AND DECISION MAKING, 2008, 8 (1)
[7]   Assessment in the context of uncertainty:: how many members are needed on the panel of reference of a script concordance test? [J].
Gagnon, R ;
Charlin, B ;
Coletti, M ;
Sauvé, E ;
van der Vleuten, C .
MEDICAL EDUCATION, 2005, 39 (03) :284-291
[8]   Script concordance testing: more cases or more questions? [J].
Gagnon, Robert ;
Charlin, Bernard ;
Lambert, Carole ;
Carriere, Benoit ;
Van der Vleuten, C. .
ADVANCES IN HEALTH SCIENCES EDUCATION, 2009, 14 (03) :367-375
[9]   The Practicum Script Concordance Test: An Online Continuing Professional Development Format to Foster Reflection on Clinical Practice [J].
Hornos, Eduardo H. ;
Pleguezuelos, Eduardo M. ;
Brailovsky, Carlos A. ;
Harillo, Leandro D. ;
Dory, Valerie ;
Charlin, Bernard .
JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS, 2013, 33 (01) :59-66
[10]   Measuring Gains in the Clinical Reasoning of Medical Students: Longitudinal Results From a School-Wide Script Concordance Test [J].
Humbert, Aloysius J. ;
Miech, Edward J. .
ACADEMIC MEDICINE, 2014, 89 (07) :1046-1050