Convolutional Neural Network-Bidirectional Gated Recurrent Unit Facial Expression Recognition Method Fused with Attention Mechanism

被引:4
|
作者
Tang, Chaolin [1 ]
Zhang, Dong [2 ]
Tian, Qichuan [1 ,3 ]
机构
[1] Beijing Univ Civil Engn & Architecture, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
[3] Beijing Key Lab Robot B & Funct Res, Beijing 100044, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 22期
关键词
facial expression recognition; attention mechanism; sliding window; Bi-GRU; EMOTION RECOGNITION; MODEL;
D O I
10.3390/app132212418
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The relationships among different subregions in facial images and their varying contributions to facial expression recognition indicate that using a fixed subregion weighting scheme would result in a substantial loss of valuable information. To address this issue, we propose a facial expression recognition network called BGA-Net, which combines bidirectional gated recurrent units (BiGRUs) with an attention mechanism. Firstly, a convolutional neural network (CNN) is employed to extract feature maps from facial images. Then, a sliding window cropping strategy is applied to divide the feature maps into multiple subregions. The BiGRUs are utilized to capture the dependencies among these subregions. Finally, an attention mechanism is employed to adaptively focus on the most discriminative regions. When evaluated on CK+, FER2013, and JAFFE datasets, our proposed method achieves promising results.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Identification of DNA modification sites based on elastic net and bidirectional gated recurrent unit with convolutional neural network
    Yu, Bin
    Zhang, Yaqun
    Wang, Xue
    Gao, Hongli
    Sun, Jianqiang
    Gao, Xin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 75
  • [42] An improved convolutional neural network-bidirectional gated recurrent unit algorithm for robust state of charge and state of energy estimation of new energy vehicles of lithium-ion batteries
    Wu, Fan
    Wang, Shunli
    Liu, Donglei
    Cao, Wen
    Fernandez, Carlos
    Huang, Qi
    JOURNAL OF ENERGY STORAGE, 2024, 82
  • [43] Bidirectional Recurrent Neural Network with Attention Mechanism for Punctuation Restoration
    Tilk, Ottokar
    Alumae, Tanel
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 3047 - 3051
  • [44] New GRU from Convolutional Neural Network and Gated Recurrent Unit
    Atassi, A.
    El Azami, I.
    Sadiq, A.
    PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE, E-LEARNING AND INFORMATION SYSTEMS 2018 (DATA'18), 2018,
  • [45] Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network
    Cheng, Shuo
    Zhou, Guohui
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2020, 34 (07)
  • [46] A Facial Expression Recognition Method based on Residual Separable Convolutional Neural Network
    Xu, Xiaoyu
    Cui, Jianfeng
    Chen, Xuhui
    Chen, Chin-Ling
    Journal of Network Intelligence, 2022, 7 (01): : 59 - 69
  • [47] Well Logging Reconstruction Based on a Temporal Convolutional Network and Bidirectional Gated Recurrent Unit Network with Attention Mechanism Optimized by Improved Sand Cat Swarm Optimization
    Wang, Guanqun
    Teng, Haibo
    Qiao, Lei
    Yu, Hongtao
    Cui, You
    Xiao, Kun
    ENERGIES, 2024, 17 (11)
  • [48] Convolutional Network with Densely Backward Attention for Facial Expression Recognition
    Hua, Cam-Hao
    Thien Huynh-The
    Seo, Hyunseok
    Lee, Sungyoung
    PROCEEDINGS OF THE 2020 14TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM), 2020,
  • [49] A Graph Neural Network Recommendation Method Integrating Multi Head Attention Mechanism and Improved Gated Recurrent Unit Algorithm
    Liu, Fang
    Wang, Juan
    Yang, Junye
    IEEE ACCESS, 2023, 11 : 116879 - 116891
  • [50] A Traffic Anomaly Detection Method Based on the Joint Model of Attention Mechanism and One-Dimensional Convolutional Neural Network-Bidirectional Long Short Term Memory
    Yin Z.
    Ma H.
    Hu T.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2023, 45 (10): : 3719 - 3728