A Novel Attention Residual Network Expression Recognition Method

被引:2
|
作者
Qi, Hui [1 ,2 ]
Zhang, Xipeng [1 ]
Shi, Ying [1 ,3 ]
Qi, Xiaobo [1 ]
机构
[1] Taiyuan Normal Univ, Sch Comp Sci & Technol, Jinzhong 030619, Peoples R China
[2] Shanxi Key Lab Intelligent Optimizat Comp & Blockc, Jinzhong 030619, Peoples R China
[3] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Residual neural networks; Residual network; pyramidal convolution; attention mechanism; facial expression recognition; NEURAL-NETWORK;
D O I
10.1109/ACCESS.2024.3365521
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Expressions serve as intuitive reflections of a person's psychological state, making the extraction of effective features for accurate facial expression recognition a crucial research problem. However, when facial information is incomplete, the existing convolutional neural networks face some challenges in extracting features. To address this issue, this paper introduces a pyramidal convolutional attention residual network(PCARNet) based on the ResNet18. PCARNet combines the pyramidal convolution module and an improved convolutional attention mechanism to effectively extract expression features and achieve high-precision facial expression recognition. The proposed model utilizes pyramidal convolution to extract facial expression features at multiple scales, capturing both global and local information of the face. Grouped convolution is employed to reduce the computational complexity and the number of parameters. Additionally, to avoid the adverse effects of channel dimensionality reduction on the attention mechanism and enhance the capacity for information exchange across channels, the Share MLP module within the convolutional attention mechanism was replaced by a one-dimensional convolution with adaptive kernel size. The improved convolutional attention mechanism assigns weights to the extracted multiscale features based on both channel and spatial dimensions, enhancing the representation of crucial facial features. Experimental results demonstrate the high recognition accuracy of the proposed method on public datasets such as Fer2013, RAF-DB, and CK+. The accuracies achieved are 73.725%, 87.516%, and 95.455%, respectively. Compared to other methods, the proposed approach shows improvements of at least 1.4%, 2.4%, and 0.25% on the respective datasets, confirming its high reliability and performance.
引用
收藏
页码:24609 / 24620
页数:12
相关论文
共 50 条
  • [1] Expression Recognition Based on Attention-Split Convolutional Residual Network
    Chen Jiamin
    Xu Yang
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (18)
  • [2] Emotion Recognition Method Based on Multiscale Attention Residual Network
    Bo Zhan Jiao
    Yuanxin Fu
    Dang N.H. Mao
    Ning Thanh
    undefined Zhang
    Pattern Recognition and Image Analysis, 2024, 34 (4) : 1000 - 1006
  • [3] Expression Recognition Method Based on Attention Neural Network
    Shi, Zhibo
    Tan, Zhi
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 856 - 860
  • [4] Video action recognition method based on attention residual network and LSTM
    Zhang, Yu
    Dong, Pengyue
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 3611 - 3616
  • [5] Novel multi-scale deep residual attention network for facial expression recognition
    Liu, Dong
    Wang, Lifeng
    Wang, Zhiyong
    Chen, Longxi
    JOURNAL OF ENGINEERING-JOE, 2020, 2020 (12): : 1220 - 1226
  • [6] Multiscale Convolutional Attention-based Residual Network Expression Recognition
    Wang, Fei
    Zhang, Haijun
    JOURNAL OF INTERNET TECHNOLOGY, 2023, 24 (05): : 1169 - 1175
  • [7] Facial expression recognition based on strong attention mechanism and residual network
    Zhizhe Qian
    Jing Mu
    Feng Tian
    Zhiyu Gao
    Jie Zhang
    Multimedia Tools and Applications, 2023, 82 : 14287 - 14306
  • [8] Facial expression recognition based on strong attention mechanism and residual network
    Qian, Zhizhe
    Mu, Jing
    Tian, Feng
    Gao, Zhiyu
    Zhang, Jie
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (09) : 14287 - 14306
  • [9] Basketball Action Recognition Method of Deep Neural Network Based on Dynamic Residual Attention Mechanism
    Xiao, Jiongen
    Tian, Wenchun
    Ding, Liping
    INFORMATION, 2023, 14 (01)
  • [10] Facial Expression Recognition Based On Residual Network
    Jiang, Qiqi
    Peng, Xiwei
    Chen, Hanyu
    Guo, Yujie
    2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 7000 - 7006