Motion-Based Educational Games: Using Multi-Modal Data to Predict Player's Performance

被引:0
作者
Lee-Cultura, Serena [1 ]
Sharma, Kshitij [1 ]
Papavlasopoulou, Sofia [1 ]
Giannakos, Michail [1 ]
机构
[1] Norwegian Univ Sci & Technol, Inst Dataeknol & Informatikk, Trondheim, Norway
来源
2020 IEEE CONFERENCE ON GAMES (IEEE COG 2020) | 2020年
关键词
motion-based games; educational games; multi-modal data; education; prediction; machine learning; MATHEMATICS; CHILDREN; KINECT;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-Modal Data (MMD) can help educational games researchers understand the synergistic relationship between player's movement and their learning experiences, and consequently uncover insights that may lead to improved design of movement-based game technologies for learning. Predicting player performance fosters opportunities to cultivate heightened educational experiences and outcomes. However, predicting player's performance utilising player-generated MMD during their interactions with educational Motion-Based Touchless Games (MBTG) is challenging. To bridge this gap, we implemented an in-situ study where 26 users, age 11, played 2 maths MBTGs in a single 20-30 minute session. We collected player's MMD (i.e., gaze data from eye-tracking glasses, physiological data from wristbands, and skeleton data from Kinect) produced during game-play. To investigate the potential of MMD for predicting player's academic performance, we used machine learning techniques and MMD derived from player's game-play. This allowed us to identify the MMD features that drive rapid highly accurate predictions of players' academic performance in educational MBTGs. This might allow us to provide real-time proactive feedback to the player to support them through their educational gaming experience. Our analysis compared two data lengths corresponding to half and full duration of the player's question solving time. We showed that all combinations of extracted features associated with gaze, physiological, and skeleton data, predicted student performance more accurately than the majority baseline. Additionally, the most accurate prediction of player's performance derived from the combination of gaze and physiological data for both full and half data lengths. Our findings emphasise the significance of using MMD for real-time performance prediction in educational MBTG and offer implications for practice.
引用
收藏
页码:17 / 24
页数:8
相关论文
共 48 条
  • [1] Adachi Takayuki., 2013, Interaction Design and Children, P364, DOI [DOI 10.1145/2485760.2485830, 10.1145/2485760]
  • [2] Altanis Ioannis, MULTIFACETED STUDENT
  • [3] Andrade A., 2017, J. Learn. Anal., V4, P18, DOI DOI 10.18608/JLA.2017.43.3
  • [4] [Anonymous], 2012, INT C ED E LEARN INN
  • [5] Bartoli L., 2013, Interaction Design and Children, P102, DOI [DOI 10.1145/2485760.2485774, 10.1145/2485760.2485774]
  • [6] Bartoli L., 2014, IDC'14 Proceedings, P17
  • [7] Bayo I., 2012, PRAT CIRN COMM INF C, V2012
  • [8] Seeking reproducibility: Assessing a multimodal study of the testing effect
    Beardsley, M.
    Hernandez-Leo, D.
    Ramirez-Melendez, R.
    [J]. JOURNAL OF COMPUTER ASSISTED LEARNING, 2018, 34 (04) : 378 - 386
  • [9] Bhattacharya A., 2015, P 14 INT C INTERACTI, P69, DOI [DOI 10.1145/2771839.2771847, 10.1145/2771839.2771847]
  • [10] SMOTE for high-dimensional class-imbalanced data
    Blagus, Rok
    Lusa, Lara
    [J]. BMC BIOINFORMATICS, 2013, 14