Realization of Self-Adaptive Higher Teaching Management Based Upon Expression and Speech Multimodal Emotion Recognition

被引:3
作者
Zhou, Huihui [1 ]
Liu, Zheng [2 ,3 ]
机构
[1] Univ Perpetual Help Syst DALTA, Sch Educ, Las Pinas, Philippines
[2] ZheJiang GongShang Univ, Sch Hunanities & Communicat, Hangzhou, Peoples R China
[3] Fudan Univ, Sch Journalism, Shanghai, Peoples R China
来源
FRONTIERS IN PSYCHOLOGY | 2022年 / 13卷
关键词
emotion recognition; higher education; facial expressions; teaching management; self-adaptive; FEATURE-SELECTION;
D O I
10.3389/fpsyg.2022.857924
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
In the process of communication between people, everyone will have emotions, and different emotions will have different effects on communication. With the help of external performance information accompanied by emotional expression, such as emotional speech signals or facial expressions, people can easily communicate with each other and understand each other. Emotion recognition is an important network of affective computers and research centers for signal processing, pattern detection, artificial intelligence, and human-computer interaction. Emotions convey important information in human communication and communication. Since the end of the last century, people have started the research on emotion recognition, especially how to correctly judge the emotion type has invested a lot of time and energy. In this paper, multi-modal emotion recognition is introduced to recognize facial expressions and speech, and conduct research on adaptive higher education management. Language and expression are the most direct ways for people to express their emotions. After obtaining the framework of the dual-modal emotion recognition system, the BOW model is used to identify the characteristic movement of local areas or key points. The recognition rates of emotion recognition for 1,000 audios of anger, disgust, fear, happiness, sadness and surprise are: 97.3, 83.75, 64.87, 89.87, 84.12, and 86.68%, respectively.
引用
收藏
页数:13
相关论文
共 30 条
  • [1] Improved Dynamic Multi-Party Quantum Private Comparison for Next-Generation Mobile Network
    Abulkasim, Hussein
    Alsuqaih, Hanan Naser
    Hamdan, Walaa Fawzy
    Hamad, Safwat
    Farouk, Ahmed
    Mashatan, Atefeh
    Ghose, Shohini
    [J]. IEEE ACCESS, 2019, 7 : 17917 - 17926
  • [2] Enhanced-AODV: A Robust Three Phase Priority-Based Traffic Load Balancing Scheme for Internet of Things
    Adil, Muhammad
    Song, Houbing
    Ali, Jehad
    Jan, Mian Ahmad
    Attique, Muhammad
    Abbas, Safia
    Farouk, Ahmed
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (16) : 14426 - 14437
  • [3] Emotion Recognition in Never-Seen Languages Using a Novel Ensemble Method with Emotion Profiles
    Albornoz, E. M.
    Milone, D. H.
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2017, 8 (01) : 43 - 53
  • [4] Usability study and pilot validation of a computer-based emotion recognition test for older adults with Alzheimer's disease and amnestic mild cognitive impairment
    Antonio Garcia-Casal, J.
    Martinez-Abad, Fernando
    Cid-Bartolome, Teresa
    Smith, Sarah Jane
    Llano-Ordonez, Katia
    Victoria Perea-Bartolome, M.
    Goni-Imizcoz, Miguel
    Soto-Perez, Felipe
    Franco-Martin, Manuel
    [J]. AGING & MENTAL HEALTH, 2019, 23 (03) : 365 - 375
  • [5] The role of infants' mother-directed gaze, maternal sensitivity, and emotion recognition in childhood callous unemotional behaviours
    Bedford, R.
    Wagner, N. J.
    Rehder, P. D.
    Propper, C.
    Willoughby, M. T.
    Mills-Koonce, R. W.
    [J]. EUROPEAN CHILD & ADOLESCENT PSYCHIATRY, 2017, 26 (08) : 947 - 956
  • [6] DNN-HMM-Based Speaker-Adaptive Emotion Recognition Using MFCC and Epoch-Based Features
    Fahad, Md. Shah
    Deepak, Akshay
    Pradhan, Gayadhar
    Yadav, Jainath
    [J]. CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2021, 40 (01) : 466 - 489
  • [7] A generalized architecture of quantum secure direct communication for N disjointed users with authentication
    Farouk, Ahmed
    Zakaria, Magdy
    Megahed, Adel
    Omara, Fatma A.
    [J]. SCIENTIFIC REPORTS, 2015, 5
  • [8] The Indian Spontaneous Expression Database for Emotion Recognition
    Happy, S. L.
    Patnaik, Priyadarshi
    Routray, Aurobinda
    Guha, Rajlakshmi
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2017, 8 (01) : 131 - 142
  • [9] Fusion of Facial Expressions and EEG for Multimodal Emotion Recognition
    Huang, Yongrui
    Yang, Jianhao
    Liao, Pengkai
    Pan, Jiahui
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2017, 2017
  • [10] Learning CNN features from DE features for EEG-based emotion recognition
    Hwang, Sunhee
    Hong, Kibeom
    Son, Guiyoung
    Byun, Hyeran
    [J]. PATTERN ANALYSIS AND APPLICATIONS, 2020, 23 (03) : 1323 - 1335