Emotion recognition and interaction of smart education environment screen based on deep learning networks

被引:0
作者
Zhao, Wei [1 ]
Qiu, Liguo [1 ]
机构
[1] Hunan Coll Informat, Dept Informat Engn, Changsha 410200, Peoples R China
关键词
deep neural network; MTCNN; 3D-CNN; intelligent education; emotion recognition;
D O I
10.1515/jisys-2024-0082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smart education environments combine technologies such as big data, cloud computing, and artificial intelligence to optimize and personalize the teaching and learning process, thereby improving the efficiency and quality of education. This article proposes a dual-stream-coded image sentiment analysis method based on both facial expressions and background actions to monitor and analyze learners' behaviors in real time. By integrating human facial expressions and scene backgrounds, the method can effectively address the occlusion problem in uncontrolled environments. To enhance the accuracy and efficiency of emotion recognition, a multi-task convolutional network is employed for face extraction, while 3D convolutional neural networks optimize the extraction process of facial features. Additionally, the adaptive learning screen adjustment system proposed in this article dynamically adjusts the presentation of learning content to optimize the learning environment and enhance learning efficiency by monitoring learners' expressions and reactions in real time. By analyzing the experimental results on the Emotic dataset, the emotion recognition model in this article shows high accuracy, especially in the recognition of specific emotion categories. This research significantly contributes to the field of smart education environments by providing an effective solution for real-time emotion recognition.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] LEARNING EMOTION-BASED ACOUSTIC FEATURES WITH DEEP BELIEF NETWORKS
    Schmidt, Erik M.
    Kim, Youngmoo E.
    2011 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS (WASPAA), 2011, : 65 - 68
  • [42] Benchmarking deep networks for facial emotion recognition in the wild
    Antonio Greco
    Nicola Strisciuglio
    Mario Vento
    Vincenzo Vigilante
    Multimedia Tools and Applications, 2023, 82 : 11189 - 11220
  • [43] Emotion recognition system for E-learning environment based on facial expressions
    Begum, Farzana
    Neelima, Arambam
    Valan, J. Arul
    SOFT COMPUTING, 2023, 27 (22) : 17257 - 17265
  • [44] Emotion Recognition Using Pretrained Deep Neural Networks
    Dobes, Marek
    Sabolova, Natalia
    ACTA POLYTECHNICA HUNGARICA, 2023, 20 (04) : 195 - 204
  • [45] Visual Emotion Recognition Using Deep Neural Networks
    Iliev, Alexander I.
    Mote, Ameya
    DIGITAL PRESENTATION AND PRESERVATION OF CULTURAL AND SCIENTIFIC HERITAGE, 2022, 12 : 77 - 88
  • [46] Emotion recognition system for E-learning environment based on facial expressions
    Farzana Begum
    Arambam Neelima
    J. Arul Valan
    Soft Computing, 2023, 27 : 17257 - 17265
  • [47] A Novel Approach for Emotion Recognition Based on EEG Signal Using Deep Learning
    Abdulrahman, Awf
    Baykara, Muhammet
    Alakus, Talha Burak
    APPLIED SCIENCES-BASEL, 2022, 12 (19):
  • [48] Deep Learning Driven Hypergraph Representation for Image-Based Emotion Recognition
    Huang, Yuchi
    Lu, Hanqing
    ICMI'16: PROCEEDINGS OF THE 18TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2016, : 243 - 247
  • [49] An attention-based hybrid deep learning model for EEG emotion recognition
    Zhang, Yong
    Zhang, Yidie
    Wang, Shuai
    SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) : 2305 - 2313
  • [50] The Efficacy of Deep Learning-Based Mixed Model for Speech Emotion Recognition
    Uddin, Mohammad Amaz
    Chowdury, Mohammad Salah Uddin
    Khandaker, Mayeen Uddin
    Tamam, Nissren
    Sulieman, Abdelmoneim
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (01): : 1709 - 1722