Gaze tutor: A gaze-reactive intelligent tutoring system

被引:189
作者
D'Mello, Sidney [1 ,2 ]
Olney, Andrew [3 ,4 ]
Williams, Claire [3 ,4 ]
Hays, Patrick [3 ,4 ]
机构
[1] Univ Notre Dame, Dept Comp Sci, Notre Dame, IN 46556 USA
[2] Univ Notre Dame, Dept Psychol, Notre Dame, IN 46556 USA
[3] Univ Memphis, Inst Intelligent Syst, Memphis, TN 38152 USA
[4] Univ Memphis, Dept Psychol, Memphis, TN 38152 USA
基金
美国国家科学基金会;
关键词
Affective computing; Affect-sensitive ITS; Boredom; Disengagement; Eye tracking; Gaze-sensitive dialogs; Intelligent tutoring systems (ITSs); Zoning out; EYE-MOVEMENTS; ACHIEVEMENT EMOTIONS; BOREDOM; ATTENTION; MODELS; ENGAGEMENT; TRACKING; OUTCOMES; STRATEGIES; DIALOGUES;
D O I
10.1016/j.ijhcs.2012.01.004
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We developed an intelligent tutoring system (ITS) that aims to promote engagement and learning by dynamically detecting and responding to students' boredom and disengagement. The tutor uses a commercial eye tracker to monitor a student's gaze patterns and identify when the student is bored, disengaged, or is zoning out. The tutor then attempts to reengage the student with dialog moves that direct the student to reorient his or her attentional patterns towards the animated pedagogical agent embodying the tutor. We evaluated the efficacy of the gaze-reactive tutor in promoting learning, motivation, and engagement in a controlled experiment where 48 students were tutored on four biology topics with both gaze-reactive and non-gaze-reactive (control condition) versions of the tutor. The results indicated that: (a) gaze-sensitive dialogs were successful in dynamically reorienting students' attentional patterns to the important areas of the interface, (b) gaze-reactivity was effective in promoting learning gains for questions that required deep reasoning, (c) gaze-reactivity had minimal impact on students' state motivation and on self-reported engagement, and (d) individual differences in scholastic aptitude moderated the impact of gaze-reactivity on overall learning gains. We discuss the implications of our findings, limitations, future work, and consider the possibility of using gaze-reactive ITSs in classrooms. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:377 / 398
页数:22
相关论文
共 112 条
  • [41] D'Mello SK, 2010, COGNITION IN FLUX, P2721
  • [42] Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features
    D'Mello, Sidney K.
    Graesser, Arthur
    [J]. USER MODELING AND USER-ADAPTED INTERACTION, 2010, 20 (02) : 147 - 187
  • [43] Attention guidance in learning from a complex animation: Seeing is understanding?
    de Koning, Bjoern B.
    Tabbers, Huib K.
    Rikers, Remy M. J. P.
    Paas, Fred
    [J]. LEARNING AND INSTRUCTION, 2010, 20 (02) : 111 - 122
  • [44] de Melo CM, 2010, LECT NOTES ARTIF INT, V6356, P357, DOI 10.1007/978-3-642-15892-6_38
  • [45] Del Soldato T., 1995, Journal of Artificial Intelligence in Education, V6, P337
  • [46] Engaging by design: How engagement strategies in popular computer and video games can inform instructional design
    Dickey, Michele D.
    [J]. ETR&D-EDUCATIONAL TECHNOLOGY RESEARCH AND DEVELOPMENT, 2005, 53 (02): : 67 - 83
  • [47] Dodds P., 2004, Journal of Educational Multimedia and Hypermedia, V13, P391
  • [48] Drummond J, 2010, LECT NOTES COMPUT SC, V6095, P306
  • [49] AN ARGUMENT FOR BASIC EMOTIONS
    EKMAN, P
    [J]. COGNITION & EMOTION, 1992, 6 (3-4) : 169 - 200
  • [50] Ericsson K. A., 1993, Protocol analysis: Verbal reports as data