How "none of the above" (NOTA) affects the accessibility of tested and related information in multiple-choice questions

被引:4
作者
Blendermann, Mary F. [1 ,3 ]
Little, Jeri L. [1 ,2 ]
Gray, Kayla M. [2 ]
机构
[1] Hillsdale Coll, Dept Psychol, Hillsdale, MI 49242 USA
[2] Calif State Univ East Bay, Dept Psychol, 25800 Carlos Bee Blvd, Hayward, CA 94542 USA
[3] Univ Calif Davis, Dept Psychiat, Davis, CA 95616 USA
关键词
Multiple-choice; testing effect; none of the above; retrieval blocking; interference; DIFFICULTY; GUIDELINES; CORRECT; ACCESS; RECALL;
D O I
10.1080/09658211.2020.1733614
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Answering multiple-choice questions increases accessibility of the tested information and can improve accessibility of related information. However, multiple-choice questions with "none of the above" (NOTA) as a choice hurts accessibility of the previously tested information when NOTA serves as the correct answer (NOTA(correct)). Would prompting participants to recall an answer when choosing NOTA, and then providing feedback, reduce the costs of NOTA(correct) items? In the present experiments, participants answered general knowledge questions in multiple-choice (with a NOTA alternative) or cued-recall formats; half of the participants, when choosing NOTA, were prompted to provide an answer. Half of the participants received feedback. On a final cued-recall test assessing performance for previously tested and nontested related information, we found that NOTA(correct) questions hurt performance for previously tested items as compared to the cued-recall condition; but they facilitated recall of related information. Feedback improved performance for all previously tested information, but performance was still worse for NOTA(correct) questions than for cued-recall questions. The addition of a cued-recall component on NOTA questions did not influence accessibility. The results have implications for using NOTA in practice tests and help explain why using NOTA(correct) items hurt learning, even with feedback, supporting a proactive interference account.
引用
收藏
页码:473 / 480
页数:8
相关论文
共 19 条
[1]   Multiple-choice testing as a desirable difficulty in the classroom [J].
Bjork, Elizabeth Ligon ;
Little, Jeri L. ;
Storm, Benjamin C. .
JOURNAL OF APPLIED RESEARCH IN MEMORY AND COGNITION, 2014, 3 (03) :165-170
[2]   Multiple-Choice Testing in Education: Are the Best Practices for Assessment Also Good for Learning? [J].
Butler, Andrew C. .
JOURNAL OF APPLIED RESEARCH IN MEMORY AND COGNITION, 2018, 7 (03) :323-331
[3]   Multiple-choice tests stabilize access to marginal knowledge [J].
Cantor, Allison D. ;
Eslick, Andrea N. ;
Marsh, Elizabeth J. ;
Bjork, Robert A. ;
Bjork, Elizabeth Ligon .
MEMORY & COGNITION, 2015, 43 (02) :193-205
[4]   The "None of the Above" Option in Multiple-Choice Testing: An Experimental Study [J].
DiBattista, David ;
Sinnige-Egger, Jo-Anne ;
Fortuna, Glenda .
JOURNAL OF EXPERIMENTAL EDUCATION, 2014, 82 (02) :168-183
[5]   THE TESTING PHENOMENON - NOT GONE BUT NEARLY FORGOTTEN [J].
GLOVER, JA .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 1989, 81 (03) :392-399
[7]   A review of multiple-choice item-writing guidelines for classroom assessment [J].
Haladyna, TM ;
Downing, SM ;
Rodriguez, MC .
APPLIED MEASUREMENT IN EDUCATION, 2002, 15 (03) :309-334
[8]   Manipulations of Choice Familiarity in Multiple-Choice Testing Support a Retrieval Practice Account of the Testing Effect [J].
Jang, Yoonhee ;
Pashler, Hal ;
Huber, David E. .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 2014, 106 (02) :435-447
[9]   The role of multiple-choice tests in increasing access to difficult-to-retrieve information [J].
Little, Jeri L. .
JOURNAL OF COGNITIVE PSYCHOLOGY, 2018, 30 (5-6) :520-531
[10]   The Role of Retrieval in Answering Multiple-Choice Questions [J].
Little, Jeri L. ;
Frickey, Elise A. ;
Fung, Alexandra K. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2019, 45 (08) :1473-1485