Exhibiting achievement behavior during computer-based testing: What temporal trace data and personality traits tell us?

被引:11
作者
Papamitsiou, Zacharoula [1 ]
Economides, Anastasios A. [1 ]
机构
[1] Univ Macedonia, IPPS Informat Syst, Egnatia St 156, Thessaloniki 54636, Greece
关键词
Assessment analytics; BFI; Computer-based testing; Personality traits; Student behavior modelling; Supervised classification; TIME-MANAGEMENT; 5-FACTOR MODEL; PERFORMANCE; CONSCIENTIOUSNESS; STRATEGIES; MOTIVATION; PREFERENCE; VARIABLES; MATTER; ONLINE;
D O I
10.1016/j.chb.2017.05.036
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Personalizing computer-based testing services to examinees can be improved by considering their behavioral models. This study aims to contribute towards deeper understanding the examinee's time spent and achievement behavior during testing according to the five personality traits by exploiting assessment analytics. Further, it aims to investigate assessment analytics appropriateness for classifying students and generating enhanced student models to guide personalization of testing services. In this study, the LAERS assessment environment and the Big Five Inventory were used to track the response times of 112 undergraduate students and to extract their personality traits respectively. Partial Least Squares was used to detect fundamental relationships between the collected data, and Supervised Learning Algorithms were used to classify students. Results indicate a positive effect of extraversion and agreeableness on goal-expectancy, a positive effect of conscientiousness on both goal-expectancy and level of certainty, and a negative effect of neuroticism and openness on level of certainty. Further, extraversion, agreeableness and conscientiousness have statistically significant indirect impact on students' response-times and level of achievement. Moreover, the ensemble RandomForest method provides accurate classification results, indicating that a time-spent driven description of students' behavior could have added value towards dynamically reshaping the respective models. Further implications of these findings are also discussed. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:423 / 438
页数:16
相关论文
共 96 条
  • [1] Abdous M, 2012, EDUC TECHNOL SOC, V15, P77
  • [2] Alpaydin E., 2010, INTRO MACHINE LEARNI
  • [3] Anderson L.W., 2001, A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives
  • [4] [Anonymous], 1992, J Pers, V60, P175
  • [5] [Anonymous], J ED BUSINESS
  • [6] [Anonymous], P KDD 2011 WORKSH KN
  • [7] [Anonymous], 1989, PLS PATH VERSION 3 0
  • [8] Barclay D., 1995, Technology Studies
  • [9] Personality and performance at the beginning of the new millennium: What do we know and where do we go next?
    Barrick, MR
    Mount, MK
    Judge, TA
    [J]. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, 2001, 9 (1-2) : 9 - 30
  • [10] Belk M, 2014, LECT NOTES COMPUT SC, V8538, P13