Deep Learning Based Emotion Recognition and Visualization of Figural Representation

被引:11
作者
Lu, Xiaofeng [1 ]
机构
[1] Shandong Univ Arts, Dept Fine Arts, Jinan, Peoples R China
来源
FRONTIERS IN PSYCHOLOGY | 2022年 / 12卷
关键词
deep learning; emotion recognition; graphic visualization; neural network; CNN-BiLSTM; SYSTEM; MODEL;
D O I
10.3389/fpsyg.2021.818833
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
This exploration aims to study the emotion recognition of speech and graphic visualization of expressions of learners under the intelligent learning environment of the Internet. After comparing the performance of several neural network algorithms related to deep learning, an improved convolution neural network-Bi-directional Long Short-Term Memory (CNN-BiLSTM) algorithm is proposed, and a simulation experiment is conducted to verify the performance of this algorithm. The experimental results indicate that the Accuracy of CNN-BiLSTM algorithm reported here reaches 98.75%, which is at least 3.15% higher than that of other algorithms. Besides, the Recall is at least 7.13% higher than that of other algorithms, and the recognition rate is not less than 90%. Evidently, the improved CNN-BiLSTM algorithm can achieve good recognition results, and provide significant experimental reference for research on learners' emotion recognition and graphic visualization of expressions in an intelligent learning environment.
引用
收藏
页数:12
相关论文
共 39 条
  • [1] Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms
    Ben, Xianye
    Ren, Yi
    Zhang, Junping
    Wang, Su-Jing
    Kpalma, Kidiyo
    Meng, Weixiao
    Liu, Yong-Jin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5826 - 5846
  • [2] Face and age recognition using three-dimensional discrete wavelet transform and rotational local binary pattern with radial basis function support vector machine method (Publication with Expression of Concern)
    Beniwal, Sonal
    Singh, Ajit
    Kant, Chander
    [J]. INTERNATIONAL JOURNAL OF ELECTRICAL ENGINEERING EDUCATION, 2021, 60 (2_suppl) : 389 - 404
  • [3] Budur T., 2021, International Journal of Social Sciences & Educational Studies, V8, P180, DOI [DOI 10.23918/IJSSES.V8I1P180, 10.1016/j.acalib.2021.102346]
  • [4] Ablate, Variate, and Contemplate: Visual Analytics for Discovering Neural Architectures
    Cashman, Dylan
    Perer, Adam
    Chang, Remco
    Strobelt, Hendrik
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (01) : 863 - 873
  • [5] Multi-Modal Emotion Recognition by Fusing Correlation Features of Speech-Visual
    Chen Guanghui
    Zeng Xiaoping
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 533 - 537
  • [6] Chuan O. W., 2020, INDONESIAN J ELECT E, V18, P1148, DOI 10.11591/ijeecs.v18.i3.pp1148-1155
  • [7] SAN-M: Memory Equipped Self-Attention for End-to-End Speech Recognition
    Gao, Zhifu
    Zhang, Shiliang
    Lei, Ming
    McLoughlin, Ian
    [J]. INTERSPEECH 2020, 2020, : 6 - 10
  • [8] Visualizing Multimodal Deep Learning for Lesion Prediction
    Gillmann, Christina
    Peter, Lucas
    Schmidt, Carlo
    Saur, Dorothee
    Scheuermann, Gerik
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2021, 41 (05) : 90 - 98
  • [9] ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context
    Han, Wei
    Zhang, Zhengdong
    Zhang, Yu
    Yu, Jiahui
    Chiu, Chung-Cheng
    Qin, James
    Gulati, Anmol
    Pang, Ruoming
    Wu, Yonghui
    [J]. INTERSPEECH 2020, 2020, : 3610 - 3614
  • [10] AN AUDIO VISUAL EMOTION RECOGNITION SYSTEM USING DEEP LEARNING FUSION FOR A COGNITIVE WIRELESS FRAMEWORK
    Hossain, M. Shamim
    Muhammad, Ghulam
    [J]. IEEE WIRELESS COMMUNICATIONS, 2019, 26 (03) : 62 - 68