A lightweight facial expression recognition model for automated engagement detection

被引:2
作者
Zhao, Zibin [1 ]
Li, Yinbei [2 ]
Yang, Jiaqiang [2 ]
Ma, Yuliang [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Engagement detection; Facial expression recognition; Lightweight model; NETWORK;
D O I
10.1007/s11760-024-03020-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Real-time monitoring of students' classroom engagement level is of paramount importance in modern education. Facial expression recognition has been extensively explored in various studies to achieve this goal. However, conventional models often grapple with a high number of parameters and substantial computational costs, limiting their practicality in real-time applications and real-world scenarios. To address this limitation, this paper proposes "Light_Fer," a lightweight model designed to attain high accuracy while reducing parameters. Light_Fer's novelty lies in the integration of depthwise separable convolution, group convolution, and inverted bottleneck structure. These techniques optimize the models' architecture, resulting in superior accuracy with fewer parameters. Experimental results demonstrate that Light_Fer, with just 0.23M parameters, achieves remarkable accuracies of 87.81% and 88.20% on FERPLUS and RAF-DB datasets, respectively. Furthermore, by establishing a correlation between facial expressions and students' engagement levels, we extend the application of Light_Fer to real-time detection and monitoring of students' engagement during classroom activities. In conclusion, the proposed Light_Fer model, with its lightweight design and enhanced accuracy, offers a promising solution for real-time student engagement monitoring through facial expression recognition.
引用
收藏
页码:3553 / 3563
页数:11
相关论文
共 41 条
  • [1] A new emotion-based affective model to detect student's engagement
    Altuwairqi, Khawlah
    Jarraya, Salma Kammoun
    Allinjawi, Arwa
    Hammami, Mohamed
    [J]. JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2021, 33 (01) : 99 - 109
  • [2] Aneja D., 2016, ACCV
  • [3] The FaceChannel: A Light-weight Deep Neural Network for Facial Expression Recognition
    Barros, Pablo
    Churamani, Nikhil
    Sciutti, Alessandra
    [J]. 2020 15TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2020), 2020, : 652 - 656
  • [4] MOOD AND MEMORY
    BOWER, GH
    [J]. AMERICAN PSYCHOLOGIST, 1981, 36 (02) : 129 - 148
  • [5] The association between academic engagement and achievement in health sciences students
    Casuso-Holgado, Maria J.
    Cuesta-Vargas, Antonio I.
    Moreno-Morales, Noelia
    Labajos-Manzanares, Maria T.
    Baron-Lopez, Francisco J.
    Vega-Cuesta, Manuel
    [J]. BMC MEDICAL EDUCATION, 2013, 13
  • [6] Chen SK, 2020, PROC CVPR IEEE, P13981, DOI 10.1109/CVPR42600.2020.01400
  • [7] Chollet F., 2016, PROC CVPR IEEE, DOI [DOI 10.1109/CVPR.2017.195, 10.1109/CVPR.2017.195]
  • [8] Coates H., 2009, ENGAGING STUDENTS SU
  • [9] Dubbaka A, 2020, IEEE GLOB ENG EDUC C, P447, DOI [10.1109/EDUCON45650.2020.9125149, 10.1109/educon45650.2020.9125149]
  • [10] Ekman P., 1978, Environ. Psychol. Nonverbal Behavior