Students' Attention Monitoring System in Learning Environments based on Artificial Intelligence

被引:5
作者
Terraza, Daniel F. [1 ]
Amaya, Mauricio [1 ]
Piedrahita-Carvajal, Alejandro [1 ]
Rodriguez-Marin, Paula A. [1 ]
Duque-Munoz, Leonardo [1 ]
Martinez-Vargas, Juan D. [1 ]
机构
[1] Inst Tecnol Metropolitano, Lab Maquinas Inteligentes & Reconocimiento Patron, Medellin, Colombia
关键词
Monitoring; Manuals; COVID-19; Multitasking; IEEE transactions; Deep learning; Computational modeling; Early warning system; Learning environment; LSTM; Students' attention; RECOGNITION;
D O I
10.1109/TLA.2022.9662181
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The students' attention level to the explanation of a given lecture is a factor that might determine the capability of retention and subsequent application of a learned concept. For this reason, students that pay attention are generally more participatory in the learning/teaching process than those who don't, and consequently, they succeed in reaching the competencies proposed in the courses. Hence, it is important to design strategies and tools that help teachers to monitor in a non-invasive way the attention level of the students, allowing them to take actions to modify the dynamics of the lectures when needed. In this work, we introduce a fully automated system to monitor the students' attention based on computer vision algorithms. To this end, we feed a recurrent neural network with one-second sequences generated by facial landmarks. This spatiotemporal analysis of video recordings allows for identifying when a student is attending a given explanation in online educational environments. The system is tested in a database with more than 3000 sequences of students who pay or no attention to online video lectures. Obtained results show that the proposed system is suitable to monitor the students' attention to a particular explanation.
引用
收藏
页码:126 / 132
页数:7
相关论文
共 26 条
[1]   How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks) [J].
Bulat, Adrian ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1021-1030
[2]  
Canedo D., 2018, P INT C PRACTICAL AP, P371, DOI [10.1007/978-3-319-94779-2_32, DOI 10.1007/978-3-319-94779-2_32]
[3]   Assessing the attention levels of students by using a novel attention aware system based on brainwave signals [J].
Chen, Chih-Ming ;
Wang, Jung-Ying ;
Yu, Chih-Ming .
BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2017, 48 (02) :348-369
[4]   Multimethod assessment of affective experience and expression during deep learning [J].
D'Mello, Sidney K. ;
Craig, Scotty D. ;
Graesser, Art C. .
INTERNATIONAL JOURNAL OF LEARNING TECHNOLOGY, 2009, 4 (3-4) :165-187
[5]   Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features [J].
D'Mello, Sidney K. ;
Graesser, Arthur .
USER MODELING AND USER-ADAPTED INTERACTION, 2010, 20 (02) :147-187
[6]  
Dinesh D, 2016, PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE (ICIS), P97, DOI 10.1109/INFOSCI.2016.7845308
[7]  
DMello S. K., 2006, International Journal of Artificial Intelligence in Education, V16, P3
[8]  
Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1007/978-3-642-24797-2, 10.1162/neco.1997.9.1.1]
[9]  
Heng Wang, 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P3169, DOI 10.1109/CVPR.2011.5995407
[10]  
Heppen J., 2008, DEV EARLY WARNING SY