How many questions should I answer? Using bias profiles to estimate optimal bias and maximum score on formula-scored tests

被引:24
作者
Higham, Philip A. [1 ]
Arnold, Michelle M. [1 ]
机构
[1] Univ Southampton, Sch Psychol, Southampton SO17 1BJ, Hants, England
来源
EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY | 2007年 / 19卷 / 4-5期
关键词
D O I
10.1080/09541440701326121
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
To maximise multiple choice test scores under formula scoring, students must be able to monitor their knowledge level, reporting correct answers and withholding incorrect ones. Importantly though, neither metacognitive monitoring nor optimal criterion setting has received much attention in the formula-scoring literature. The present research examined the role that both these parameters have on obtained test score. Students wrote three exams under formula-scoring rules, and from these data, we created bias profiles using methodology developed by Higham ( 2007), which allowed us to estimate the optimal number of questions that students needed to answer to maximise their scores. The results indicated that higher scoring students monitored their knowledge best, but that all students tended to guess too often, lowering their test scores. This conservatism maintained despite feedback from previous tests. The results also showed that monitoring is a stable participant skill that generalises across tests.
引用
收藏
页码:718 / 742
页数:25
相关论文
共 21 条
[1]   SIGNAL DETECTION THEORY AND HUMAN MEMORY [J].
BANKS, WP .
PSYCHOLOGICAL BULLETIN, 1970, 74 (02) :81-99
[3]   2 TYPES OF ROC CURVES AND DEFINITIONS OF PARAMETERS [J].
CLARKE, FR ;
BIRDSALL, TG ;
TANNER, WP .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1959, 31 (05) :629-630
[4]   EMPIRICAL-TEST OF LORDS THEORETICAL RESULTS REGARDING FORMULA SCORING OF MULTIPLE-CHOICE TESTS [J].
CROSS, LH ;
FRARY, RB .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1977, 14 (04) :313-321
[5]   BLIND GUESSING ON OBJECTIVE ACHIEVEMENT TESTS [J].
EBEL, RL .
JOURNAL OF EDUCATIONAL MEASUREMENT, 1968, 5 (04) :321-325
[6]   Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions [J].
Galvin, SJ ;
Podd, JV ;
Drga, V ;
Whitmore, J .
PSYCHONOMIC BULLETIN & REVIEW, 2003, 10 (04) :843-876
[7]   Strong cues are not necessarily weak: Thomson and Tulving (1970) and the encoding specificity principle revisited [J].
Higham, PA .
MEMORY & COGNITION, 2002, 30 (01) :67-80
[8]   No special k! A signal detection framework for the strategic regulation of memory accuracy [J].
Higham, Philip A. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2007, 136 (01) :1-22
[9]   On scoring multiple response tests [J].
Holzinger, KJ .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 1924, 15 :445-447
[10]   Repeated testing sessions and scholastic aptitude in college students' metacognitive accuracy [J].
Kelemen, William L. ;
Winningham, Robert G. ;
Weaver, Charles A., III .
EUROPEAN JOURNAL OF COGNITIVE PSYCHOLOGY, 2007, 19 (4-5) :689-717