A comparison of human and computer marking of short free-text student responses

被引：31
作者：
Butcher, Philip G. [1 ]
Jordan, Sally E. [1 ]
机构：
[1] Open Univ, Ctr Open Learning Math Sci Comp & Technol, Milton Keynes MK7 6AA, Bucks, England
来源：
COMPUTERS & EDUCATION | 2010年 / 55卷 / 02期
关键词：
Authoring tools and methods; QUESTIONS;
D O I：
10.1016/j.compedu.2010.02.012
中图分类号：
TP39 [计算机的应用];
学科分类号：
081203 ; 0835 ;
摘要：
The computer marking of short-answer free-text responses of around a sentence in length has been found to be at least as good as that of six human markers. The marking accuracy of three separate computerised systems has been compared, one system (Intelligent Assessment Technologies FreeText Author) is based on computational linguistics whilst two (Regular Expressions and OpenMark) are based on the algorithmic manipulation of keywords. in all three cases, the development of high-quality response matching has been achieved by the use of real student responses to developmental versions of the questions and FreeText Author and OpenMark have been found to produce marking of broadly similar accuracy. Reasons for lack of accuracy in human marking and in each of the computer systems are discussed. (C) 2010 Elsevier Ltd. All rights reserved.
引用
收藏
页码：489 / 499
页数：11
相关论文
共 18 条
  • [1] [Anonymous], 2006, J TECHNOLOGY LEARNIN
  • [2] [Anonymous], 2006, Innovative Assessment in Higher Education
  • [3] BUTCHER PG, 2006, OPENMARK EXAMPLES
  • [4] BUTCHER PG, 2009, 23 ICDE WORLD C OP L
  • [5] FREAN A, 2008, GCSE LEVEL EXAM RESU
  • [6] Gibbs G., 2005, LEARNING TEACHING HI, P3, DOI DOI 10.1007/978-3-8348-9837-1
  • [7] e-Assessment for learning? The potential of short-answer free-text questions with tailored feedback
    Jordan, Sally
    Mitchell, Tom
    [J]. BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2009, 40 (02) : 371 - 385
  • [8] C-rater: Automated scoring of short-answer questions
    Leacock, C
    Chodorow, M
    [J]. COMPUTERS AND THE HUMANITIES, 2003, 37 (04): : 389 - 405
  • [9] MITCHELL T, 2002, 6 INT CAA C LOUGHB U
  • [10] MITCHELL T, 2003, 10 COMP ASS ASS C LO
12