Reliability of speeded number-right multiple-choice tests

被引：12

作者：

Attali, Y ^{[1
]}

机构：

[1] Educ Testing Serv, Princeton, NJ 08541 USA

来源：

APPLIED PSYCHOLOGICAL MEASUREMENT | 2005年 / 29卷 / 05期

关键词：

reliability; speededness; multiple-choice tests;

D O I：

10.1177/0146621605276676

中图分类号：

O1 [数学]; C [社会科学总论];

学科分类号：

03 ; 0303 ; 0701 ; 070101 ;

摘要：

Contrary to common belief, reliability estimates of number-right multiple-choice tests are not inflated by speededness. Because examinees guess on questions when they run out of time, the responses to these questions generally show less consistency with the responses of other questions, and the reliability of the test will be decreased. The surprising implication is that adding questions to a multiple-choice test may lower its reliability when the test is speeded. This article develops the mathematical derivations and shows the effects of speededness on reliability in simulations.

引用

页码：357 / 368

页数：12

共 11 条

[1]

ANASTASI A, 1997, PSYCHOL TESTING, P102

[2]

[Anonymous], ED MEASUREMENT

[3]

Crocker L., 1986, INTRO CLASSICAL MODE, P143

[4]

Gulliksen H., 1950, THEORY MENTAL TESTS

[5]

Johnson M. E., 1987, MULTIVARIATE STAT SI

[6]

Lord F. M., 1968, Statistical theories of mental test scores

[7]

Schnipke DL, 2002, COMPUTER-BASED TESTING: BUILDING THE FOUNDATION FOR FUTURE ASSESSMENTS, P237

[8] Modeling item response times with a two-state mixture model: A new method of measuring speededness [J].

Schnipke, DL ;

Scrams, DJ .

JOURNAL OF EDUCATIONAL MEASUREMENT, 1997, 34 (03) :213-232

[9]

SCRAMS DJ, 1997, M NAT COUNC MEAS ED

[10]

TRAUB RE, 1994, RELIABILITY SOCIAL S, P98

← 1 2 →