A facial expression recognition network based on attention double branch enhanced fusion

被引:0
作者
Wang, Wenming [1 ]
Jia, Min [2 ]
机构
[1] West Anhui University, Anhui, Lu’an
[2] Lu’an Hospital Affiliated to Anhui Medical University, Anhui, Lu’an
关键词
Decision level fusion; Facial expression recognition; Global enhanced features; Local attention features; Loss function;
D O I
10.7717/PEERJ-CS.2266
中图分类号
学科分类号
摘要
The facial expression reflects a person’s emotion, cognition, and even physiological or mental state to a large extent. It has important application value in medical treatment, business, criminal investigation, education, and human-computer interaction. Automatic facial expression recognition technology has become an important research topic in computer vision. To solve the problems of insufficient feature extraction, loss of local key information, and low accuracy in facial expression recognition, this article proposes a facial expression recognition network based on attention double branch enhanced fusion. Two parallel branches are used to capture global enhancement features and local attention semantics respectively, and the fusion and complementarity of global and local information is realized through decision-level fusion. The experimental results show that the features extracted by the network are made more complete by fusing and enhancing the global and local features. The proposed method achieves 89.41% and 88.84% expression recognition accuracy on the natural scene face expression datasets RAF-DB and FERPlus, respectively, which is an excellent performance compared with many current methods and demonstrates the effectiveness and superiority of the proposed network model. © 2024 Wang and Jia
引用
收藏
页码:1 / 23
页数:22
相关论文
共 54 条
[1]  
Adil B, Nadjib KM, Yacine L., A novel approach for facial expression recognition, 2019 International Conference on Networking and Advanced Systems (ICNAS), pp. 1-5, (2019)
[2]  
Al-Modwahi AAM, Sebetela O, Batleng LN, Parhizkar B, Lashkari AH., Facial expression recognition intelligent security system for real time surveillance, Proceeding of World Congress in Computer Science, Computer Engineering, and Applied Computing, (2012)
[3]  
Barsoum E, Zhang C, Ferrer CC, Zhang Z., Training deep networks for facial expression recognition with crowd-sourced label distribution, Proceedings of the 18th ACM International Conference on Multimodal Interaction, pp. 279-283, (2016)
[4]  
Bashyal S, Venayagamoorthy GK., Recognition of facial expressions using Gabor wavelets and learning vector quantization, Engineering Applications of Artificial Intelligence, 21, 7, pp. 1056-1064, (2008)
[5]  
Berretti S, Del Bimbo A, Pala P, Amor BB, Daoudi M., A set of selected SIFT features for 3D facial expression recognition, 2010 20th International Conference on Pattern Recognition, pp. 4125-4128, (2010)
[6]  
Cha HS, Choi SJ, Im CH., Real-time recognition of facial expressions using facial electromyograms recorded around the eyes for social virtual reality applications, IEEE Access, 8, pp. 62065-62075, (2020)
[7]  
Chaudhari S, Mithal V, Polatkan G, Ramanath R., An attentive survey of attention models, ACM Transactions on Intelligent Systems and Technology (TIST), 12, 5, pp. 1-32, (2021)
[8]  
Chen B, Guan W, Li P, Ikeda N, Hirasawa K, Lu H., Residual multi-task learning for facial landmark localization and expression recognition, Pattern Recognition, 115, 6, (2021)
[9]  
Comas J, Aspandi D, Binefa X., End-to-end facial and physiological model for affective computing and applications, 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp. 93-100, (2020)
[10]  
Gao W, Li L, Zhao H., Facial expression recognition method based on SpResNet-ViT, 2022 2nd Asia-Pacific Conference on Communications Technology and Computer Science (ACCTCS), pp. 182-187, (2022)