On Flexible Multiple Choice Questions With Parameters

被引:0
作者
Schwinning, Nils [1 ]
Striewe, Michael [1 ]
Savija, Marinko [1 ]
Goedicke, Michael [1 ]
机构
[1] Univ Duisburg Essen, Essen, Germany
来源
PROCEEDINGS OF THE 14TH EUROPEAN CONFERENCE ON R-LEARNING (ECEL 2015) | 2015年
关键词
e-assessment; multiple choice questions; learning analytics; adaptivity;
D O I
暂无
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Flexible multiple choice questions with configurable random answer options are a common feature in advanced e-assessment systems. Variable parameters can be used to create different versions of an exercise, each time a student looks at it. The approach can be applied to parameterize complete choices of an item as well as particular values appearing in the question and individual answers. However, plain uncontrolled randomization may result in a loss of exercise quality. In fact, writing good multiple choice questions is an established subject of research in classical test theory and item response theory, both subfields of psychometrics. In particular plausible distracters play an important role for measuring the learning outcome of students. A distracter is considered as plausible, when it is based on a common misconception about the task. In this context the quality of a distracter can be measured by evaluating how often the distracter was selected. Distracters that are selected too infrequently (e.g. < 5%) are called non-functioning distracters. They are regarded to be ineffective and they should be removed from the item. On the other hand, one can assign a difficulty to a distracter, depending on its selection frequency. The more often a functioning distracter is selected, the more difficult it appears to be. This paper presents how we can use the concept of parameterizing multiple choice questions inside the e-assessment system JACK to design exercises with good distracters. In particular it is our aim to obtain a pool of functioning distracters with different levels of difficulty. This enables us to parameterize the distracters of an exercise depending on the context in which the exercise is used. We give a case study of a distracter analysis for an exercise that was used in a preparation course for mathematics at our university. We show how we can identify and remove non-functioning distracters from the exercise. We can group the remaining distracters by their level of difficulty and achieve promising progress towards adaptivity through this approach.
引用
收藏
页码:523 / 529
页数:7
相关论文
共 6 条
[1]   Examination of the Quality of Multiple-choice Items on Classroom Tests [J].
DiBattista, David ;
Kurzawa, Laura .
CANADIAN JOURNAL FOR THE SCHOLARSHIP OF TEACHING AND LEARNING, 2011, 2 (02)
[2]   HOW MANY OPTIONS IS ENOUGH FOR A MULTIPLE-CHOICE TEST ITEM [J].
HALADYNA, TM ;
DOWNING, SM .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1993, 53 (04) :999-1010
[3]  
Haladyna TM, 1988, ANN M AM ED RES ASS
[4]  
Haladyna TM., 1989, Applied Measurement in Education, V1, P51, DOI DOI 10.1207/S15324818AME02014
[5]  
Mkrtchyan A, 2011, DISTRACTER QUALITY A
[6]   Analysis of distractor difficulty in multiple-choice items [J].
Revuelta, J .
PSYCHOMETRIKA, 2004, 69 (02) :217-234