Classroom Expression Recognition Based on Deep Learning

被引:0
作者
Gao, Yang [1 ]
Zhou, Linyan [2 ]
He, Jialiang [2 ]
机构
[1] Dalian Nationalities Univ, Coll Int Business, Dalian 116600, Peoples R China
[2] Dalian Nationalities Univ, Coll Informat & Commun Engn, Dalian 116600, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2025年 / 15卷 / 01期
关键词
expression recognition; deep learning; attention mechanism; smart classroom; DATABASE; FACES;
D O I
10.3390/app15010166
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
In the field of education, classroom expression recognition technology has important application value. It can help teachers understand students' emotions and learning attitudes and adjust teaching strategies in time to improve learning outcomes. However, in a classroom environment with a large number of students, it is difficult for teachers to monitor individual learning progress, resulting in low classroom management efficiency, insufficient teaching personalization, and imperfect student evaluation mechanisms. To address the above problems, this paper constructs a dataset covering five typical classroom expressions (resistance, confusion, understanding, fatigue, and neutrality). To address the problem of insufficient data volume, this paper introduces a data enhancement method based on generative adversarial networks to improve the diversity and quality of the dataset. At the same time, a multi-attention fusion network (MAF-ER) is proposed, which combines spatial attention mechanism, channel attention mechanism, and self-attention mechanism. Experimental results show that the expression recognition accuracy of the MAF-ER algorithm reaches 88.34%, which is better than the baseline method. The ablation experiment further verifies the effectiveness of the multi-level attention (MLA) mechanism. The results show that the proposed method has a high accuracy in expression recognition tasks and provides strong support for smart classrooms.
引用
收藏
页数:22
相关论文
共 29 条
  • [1] Affective database for e-learning and classroom environments using Indian students' faces, hand gestures and body postures
    Ashwin, T. S.
    Guddeti, Ram Mohana Reddy
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 (108): : 334 - 348
  • [2] Training Deep Networks for Facial Expression Recognition with Crowd-Sourced Label Distribution
    Barsoum, Emad
    Zhang, Cha
    Ferrer, Cristian Canton
    Zhang, Zhengyou
    [J]. ICMI'16: PROCEEDINGS OF THE 18TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2016, : 279 - 283
  • [3] EmotioNet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild
    Benitez-Quiroz, C. Fabian
    Srinivasan, Ramprakash
    Martinez, Aleix M.
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 5562 - 5570
  • [4] Spontaneous facial expression database for academic emotion inference in online learning
    Bian, Cunling
    Zhang, Ya
    Yang, Fei
    Bi, Wei
    Lu, Weigang
    [J]. IET COMPUTER VISION, 2019, 13 (03) : 329 - 337
  • [5] Island Loss for Learning Discriminative Features in Facial Expression Recognition
    Cai, Jie
    Meng, Zibo
    Khan, Ahmed Shehab
    Li, Zhiyuan
    O'Reilly, James
    Tong, Yan
    [J]. PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 302 - 309
  • [6] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [7] Darayseh AA., 2023, Computers and Education Artificial Intelligence, V4, DOI [DOI 10.1016/J.CAEAI.2023.100132, 10.1016/j.caeai.2023.100132]
  • [8] Development of Real-Time Landmark-Based Emotion Recognition CNN for Masked Faces
    Farkhod, Akhmedov
    Abdusalomov, Akmalbek Bobomirzaevich
    Mukhiddinov, Mukhriddin
    Cho, Young-Im
    [J]. SENSORS, 2022, 22 (22)
  • [9] Explainable artificial intelligence for education and training
    Fiok, Krzysztof
    Farahani, Farzad, V
    Karwowski, Waldemar
    Ahram, Tareq
    [J]. JOURNAL OF DEFENSE MODELING AND SIMULATION-APPLICATIONS METHODOLOGY TECHNOLOGY-JDMS, 2022, 19 (02): : 133 - 144
  • [10] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144