Is Cronbach's alpha sufficient for assessing the reliability of the OSCE for an internal medicine course?

被引：20

作者：

Al-Osail A.M. ^{[1
]}

Al-Sheikh M.H. ^{[2
]}

Al-Osail E.M. ^{[1
]}

Al-Ghamdi M.A. ^{[2
]}

Al-Hawas A.M. ^{[2
]}

Al-Bahussain A.S. ^{[2
]}

Al-Dajani A.A. ^{[2
]}

机构：

[1] University of Dammam, Prince Saud bin Fahd Street, PO Box 3669, Khobar

[2] University of Dammam, PO Box 2435, Dammam

来源：

BMC Research Notes | / 8卷 / 1期

关键词：

Cronbach's alpha; OSCE; Pearson's correlation; R2; coefficient; Reliability; Spearman's rank correlation; Validity;

D O I：

10.1186/s13104-015-1533-x

中图分类号：

学科分类号：

摘要：

Background: The number of medical students accepted into medical programs is increasing, which has made the traditional long/short case style of examination difficult to conduct. At Dammam University, the program is shifting to the use of the Objective Structural Clinical Examination (OSCE), which may solve some of these difficulties, including issues with reliability, validity index and exam duration. Results: A pilot study was conducted over one semester. A total of 207 examinees in three groups took the OSCE and written exams. The OSCE consisted of 18 clinical stations and required 3-4.3 h/day. The written exam contained 80 multiple-choice questions. The Cronbach's alpha for each group was 0.7, 0.8, and 0.9. Correlations for all stations ranged from 0.7 to 0.8, which indicated good stability and internal consistency with minor differences in the progression of the indexes. The reliability of the written exam was 0.79, and the validity of the OSCE was 0.63, as assessed using Pearson's correlation. Conclusion: No single reliability index can be considered a perfect assessment tool to solve this issue. Thus, at least two to three indexes should be used to ensure the reliability of the OSCE. © 2015 Al-Osail et al.

引用

共 20 条

[1]

Harden R.M., Gleeson F.A., Assessment of medical competence using an objective structured clinical examination (OSCE), Med Educ, 13, pp. 39-54, (1979)

[2]

Cronbach L., Coefficient alpha and the internal structureof tests, Psychometrika, 16, pp. 297-334, (1951)

[3]

Streiner D., Starting at the beginning: an introduction to coefficient alpha and internal consistency, J Pers Asses, 80, pp. 99-103, (2003)

[4]

Graham J.M., Congeneric and (Essentially) Tau-Equivalent estimates of score reliability: what they are and how to use them, Educ Psychol Measur, 66, pp. 930-944, (2006)

[5]

Nunnally J., Bernstein L., Psychometric theory, (1994)

[6]

Tavakol M., Dennick R., Making sense of Cronbach's alpha, Int J Med Educ, 2, pp. 53-55, (2011)

[7]

Minion D.J., Donnelly M.B., Quick R.C., Pulito A., Schwartz R., Are multiple objective measures of student performance necessary?, Am J Surg, 183, pp. 663-665, (2002)

[8]

Auewarakul C., Downing S., Praditsuwan R., Jaturatamrong U., Item analysis to improve reliability for an internal medicine undergraduate OSCE, Adv Health Sci Educ Theory Pract, 10, pp. 105-113, (2005)

[9]

Eberhard L., Hassel A., Baumer A., Becker F., Beck-Mussotter J., Bomicke W., Et al., Analysis of quality and feasibility of an objective structured clinical examination (OSCE) in preclinical dental education, Eur J Dent Educ, 15, pp. 172-178, (2011)

[10]

Iramaneerat C., Yudkowsky R., Myford C.M., Downing S., Quality control of an OSCE using generalizability theory and many-faceted Rasch measurement, Adv Health Sci Educ Theory Pract, 13, pp. 479-493, (2008)

← 1 2 →