Convolutional Neural Network-Bidirectional Gated Recurrent Unit Facial Expression Recognition Method Fused with Attention Mechanism

被引:4
|
作者
Tang, Chaolin [1 ]
Zhang, Dong [2 ]
Tian, Qichuan [1 ,3 ]
机构
[1] Beijing Univ Civil Engn & Architecture, Sch Elect & Informat Engn, Beijing 100044, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
[3] Beijing Key Lab Robot B & Funct Res, Beijing 100044, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 22期
关键词
facial expression recognition; attention mechanism; sliding window; Bi-GRU; EMOTION RECOGNITION; MODEL;
D O I
10.3390/app132212418
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The relationships among different subregions in facial images and their varying contributions to facial expression recognition indicate that using a fixed subregion weighting scheme would result in a substantial loss of valuable information. To address this issue, we propose a facial expression recognition network called BGA-Net, which combines bidirectional gated recurrent units (BiGRUs) with an attention mechanism. Firstly, a convolutional neural network (CNN) is employed to extract feature maps from facial images. Then, a sliding window cropping strategy is applied to divide the feature maps into multiple subregions. The BiGRUs are utilized to capture the dependencies among these subregions. Finally, an attention mechanism is employed to adaptively focus on the most discriminative regions. When evaluated on CK+, FER2013, and JAFFE datasets, our proposed method achieves promising results.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Attention-Based Convolutional Neural Network and Bidirectional Gated Recurrent Unit for Human Activity Recognition
    Tao, Shuai
    Zhao, Zhiqiang
    Qin, Jing
    Ji, Changqing
    Wang, Zumin
    2020 5TH INTERNATIONAL CONFERENCE ON MECHANICAL, CONTROL AND COMPUTER ENGINEERING (ICMCCE 2020), 2020, : 1128 - 1134
  • [2] Recognition method of abnormal driving behavior using the bidirectional gated recurrent unit and convolutional neural network
    Zhang, Yu
    He, Yingying
    Zhang, Likai
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 609
  • [3] Aircraft Trajectory Prediction Based on Bayesian Optimised Temporal Convolutional Network-Bidirectional Gated Recurrent Unit Hybrid Neural Network
    Huang, Jin
    Ding, Weijie
    INTERNATIONAL JOURNAL OF AEROSPACE ENGINEERING, 2022, 2022
  • [4] Remaining Useful Life Prediction Method of Offshore Equipment Bearings Based on Convolutional Neural Network-Bidirectional Gated Recurrent Unit-Squeeze and Excitation
    Jin, Yan
    Xin, Wang
    Dapeng, Zhang
    Zhiqiang, Liao
    Ximing, Wu
    JOURNAL OF NANOELECTRONICS AND OPTOELECTRONICS, 2022, 17 (10) : 1343 - 1353
  • [5] Recognition of Teachers' Facial Expression Intensity Based on Convolutional Neural Network and Attention Mechanism
    Zheng, Kun
    Yang, Dong
    Liu, Junhua
    Cui, Jinling
    IEEE ACCESS, 2020, 8 : 226437 - 226444
  • [6] Mandarin Recognition Based on Self-Attention Mechanism with Deep Convolutional Neural Network (DCNN)-Gated Recurrent Unit (GRU)
    Chen, Xun
    Wang, Chengqi
    Hu, Chao
    Wang, Qin
    BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (12)
  • [7] Prediction of Network Security Situation Based on Attention Mechanism and Convolutional Neural Network-Gated Recurrent Unit
    Feng, Yuan
    Zhao, Hongying
    Zhang, Jianwei
    Cai, Zengyu
    Zhu, Liang
    Zhang, Ran
    APPLIED SCIENCES-BASEL, 2024, 14 (15):
  • [8] Facial Expression Recognition In The Wild Using Bidirectional Convolutional Neural Network
    Liu, Jiaxu
    3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (IEEE ICAIIC 2021), 2021, : 26 - 30
  • [9] Attention Mechanism with Gated Recurrent Unit Using Convolutional Neural Network for Aspect Level Opinion Mining
    Rani, Meesala Shobha
    Subramanian, Sumathy
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2020, 45 (08) : 6157 - 6169
  • [10] Attention Mechanism with Gated Recurrent Unit Using Convolutional Neural Network for Aspect Level Opinion Mining
    Meesala Shobha Rani
    Sumathy Subramanian
    Arabian Journal for Science and Engineering, 2020, 45 : 6157 - 6169