A lightweight facial expression recognition model for automated engagement detection

被引:2
作者
Zhao, Zibin [1 ]
Li, Yinbei [2 ]
Yang, Jiaqiang [2 ]
Ma, Yuliang [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[2] Zhejiang Univ, Coll Elect Engn, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
Engagement detection; Facial expression recognition; Lightweight model; NETWORK;
D O I
10.1007/s11760-024-03020-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Real-time monitoring of students' classroom engagement level is of paramount importance in modern education. Facial expression recognition has been extensively explored in various studies to achieve this goal. However, conventional models often grapple with a high number of parameters and substantial computational costs, limiting their practicality in real-time applications and real-world scenarios. To address this limitation, this paper proposes "Light_Fer," a lightweight model designed to attain high accuracy while reducing parameters. Light_Fer's novelty lies in the integration of depthwise separable convolution, group convolution, and inverted bottleneck structure. These techniques optimize the models' architecture, resulting in superior accuracy with fewer parameters. Experimental results demonstrate that Light_Fer, with just 0.23M parameters, achieves remarkable accuracies of 87.81% and 88.20% on FERPLUS and RAF-DB datasets, respectively. Furthermore, by establishing a correlation between facial expressions and students' engagement levels, we extend the application of Light_Fer to real-time detection and monitoring of students' engagement during classroom activities. In conclusion, the proposed Light_Fer model, with its lightweight design and enhanced accuracy, offers a promising solution for real-time student engagement monitoring through facial expression recognition.
引用
收藏
页码:3553 / 3563
页数:11
相关论文
共 41 条
  • [21] Searching for MobileNetV3
    Howard, Andrew
    Sandler, Mark
    Chu, Grace
    Chen, Liang-Chieh
    Chen, Bo
    Tan, Mingxing
    Wang, Weijun
    Zhu, Yukun
    Pang, Ruoming
    Vasudevan, Vijay
    Le, Quoc V.
    Adam, Hartwig
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1314 - 1324
  • [22] Densely Connected Convolutional Networks
    Huang, Gao
    Liu, Zhuang
    van der Maaten, Laurens
    Weinberger, Kilian Q.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2261 - 2269
  • [23] Iandola F. N., 2016, PREPRINT
  • [24] Facial Expression Recognition with Inconsistently Annotated Datasets
    Zeng, Jiabei
    Shan, Shiguang
    Chen, Xilin
    [J]. COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 : 227 - 243
  • [25] Li YJ, 2019, PR MACH LEARN RES, V101, P897
  • [26] Occlusion Aware Facial Expression Recognition Using CNN With Attention Mechanism
    Li, Yong
    Zeng, Jiabei
    Shan, Shiguang
    Chen, Xilin
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) : 2439 - 2450
  • [27] Deep facial spatiotemporal network for engagement prediction in online learning
    Liao, Jiacheng
    Liang, Yan
    Pan, Jiahui
    [J]. APPLIED INTELLIGENCE, 2021, 51 (10) : 6609 - 6621
  • [28] ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design
    Ma, Ningning
    Zhang, Xiangyu
    Zheng, Hai-Tao
    Sun, Jian
    [J]. COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 122 - 138
  • [29] Mehrabian A., 1968, U E LOND, V24, P1084
  • [30] Mollahosseini A, 2016, IEEE WINT CONF APPL