Seek whence: Answer sequences and their consequences in key-balanced multiple-choice tests

被引:20
作者
Bar-Hillel, M [1 ]
Attali, Y
机构
[1] Hebrew Univ Jerusalem, Ctr Rat, Jerusalem, Israel
[2] Educ Testing Serv, Princeton, NJ 08541 USA
关键词
randomization; SAT; testwiseness;
D O I
10.1198/000313002623
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The producers of the SAT balance answer keys rather than randomizing them. Whereas randomization yields keys that are balanced only on average, balancing assures this in every subtest. Balancing is a well-kept trade secret, and there is no evidence of awareness that it is exploitable. However, balancing leaves identifiable traces on answer keys. We present the evidence for key balancing, its signatures, and the ways in which testwise examinees can exploit it. Exploitation can add as much as 16 points to one's SAT score.
引用
收藏
页码:299 / 303
页数:5
相关论文
共 18 条
  • [1] ANDERSON SB, 1952, J EDUC PSYCHOL, V43, P364
  • [2] [Anonymous], 1989, ED MEASUREMENT
  • [3] ATTALI Y, IN PRESS J ED MEASUR
  • [4] THE PERCEPTION OF RANDOMNESS
    BARHILLEL, M
    WAGENAAR, WA
    [J]. ADVANCES IN APPLIED MATHEMATICS, 1991, 12 (04) : 428 - 454
  • [5] BARHILLEL M, 2001, SEEK WHENCE ANSWER S
  • [6] BROWNSTEIN SC, 1982, BARRONS PREPARE COLL
  • [7] Carter K., 1986, ED MEASUREMENT ISSUE, V5, P20, DOI [10.1111/emip.1986.5.issue-4, DOI 10.1111/J.1745-3992.1986.TB00495.X]
  • [8] Claman C., 1997, 10 REAL SATS
  • [9] DUNCALF B, 1994, PASS ANY EXAM
  • [10] Haladyna T. M, 1994, DEV VALIDATING MULTI