Emotion recognition and interaction of smart education environment screen based on deep learning networks

被引:0
作者
Zhao, Wei [1 ]
Qiu, Liguo [1 ]
机构
[1] Hunan Coll Informat, Dept Informat Engn, Changsha 410200, Peoples R China
关键词
deep neural network; MTCNN; 3D-CNN; intelligent education; emotion recognition;
D O I
10.1515/jisys-2024-0082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smart education environments combine technologies such as big data, cloud computing, and artificial intelligence to optimize and personalize the teaching and learning process, thereby improving the efficiency and quality of education. This article proposes a dual-stream-coded image sentiment analysis method based on both facial expressions and background actions to monitor and analyze learners' behaviors in real time. By integrating human facial expressions and scene backgrounds, the method can effectively address the occlusion problem in uncontrolled environments. To enhance the accuracy and efficiency of emotion recognition, a multi-task convolutional network is employed for face extraction, while 3D convolutional neural networks optimize the extraction process of facial features. Additionally, the adaptive learning screen adjustment system proposed in this article dynamically adjusts the presentation of learning content to optimize the learning environment and enhance learning efficiency by monitoring learners' expressions and reactions in real time. By analyzing the experimental results on the Emotic dataset, the emotion recognition model in this article shows high accuracy, especially in the recognition of specific emotion categories. This research significantly contributes to the field of smart education environments by providing an effective solution for real-time emotion recognition.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Deep Learning Based Audio-Visual Emotion Recognition in a Smart Learning Environment
    Ivleva, Natalja
    Pentel, Avar
    Dunajeva, Olga
    Justsenko, Valeria
    TOWARDS A HYBRID, FLEXIBLE AND SOCIALLY ENGAGED HIGHER EDUCATION, VOL 1, ICL 2023, 2024, 899 : 420 - 431
  • [2] Deep Learning Based Facial Emotion Recognition System
    Ozdemir, Mehmet Akif
    Elagoz, Berkay
    Soy, Aysegul Alaybeyoglu
    Akan, Aydin
    2020 MEDICAL TECHNOLOGIES CONGRESS (TIPTEKNO), 2020,
  • [3] Music Emotion Recognition Based on Deep Learning: A Review
    Jiang, Xingguo
    Zhang, Yuchao
    Lin, Guojun
    Yu, Ling
    IEEE ACCESS, 2024, 12 : 157716 - 157745
  • [4] Deep Learning based Emotion Recognition IoT System
    Yokoo, Kentaro
    Atsumi, Masahiko
    Tanaka, Kei
    Wang, Haoqing
    Meng, Lin
    2020 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2020, : 203 - 207
  • [5] An Emotion Recognition Model Based on Facial Recognition in Virtual Learning Environment
    Yang, D.
    Alsadoon, Abeer
    Prasad, P. W. C.
    Singh, A. K.
    Elchouemi, A.
    6TH INTERNATIONAL CONFERENCE ON SMART COMPUTING AND COMMUNICATIONS, 2018, 125 : 2 - 10
  • [6] Respiration-based emotion recognition with deep learning
    Zhang, Qiang
    Chen, Xianxiang
    Zhan, Qingyuan
    Yang, Ting
    Xia, Shanhong
    COMPUTERS IN INDUSTRY, 2017, 92-93 : 84 - 90
  • [7] A Systematic Exploration of Deep Neural Networks for EDA-Based Emotion Recognition
    Yu, Dian
    Sun, Shouqian
    INFORMATION, 2020, 11 (04)
  • [8] AN EEG-BASED EMOTION RECOGNITION MODEL USING AN INTERACTION DESIGN FRAMEWORK AND DEEP LEARNING
    Wang, Li
    Go, Jungwook
    Chen, Xiang
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2024, 24 (02)
  • [9] An Efficient Deep Learning with Optimization Algorithm for Emotion Recognition in Social Networks
    Ambika, G. N.
    Suresh, Yeresime
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (08) : 206 - 215
  • [10] SPATIOTEMPORAL ATTENTION BASED DEEP NEURAL NETWORKS FOR EMOTION RECOGNITION
    Lee, Jiyoung
    Kim, Sunok
    Kim, Seungryong
    Sohn, Kwanghoon
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 1513 - 1517