Facial expression recognition using densely connected convolutional neural network and hierarchical spatial attention

被引:23
作者
Gan, Chenquan [1 ,2 ,3 ]
Xiao, Junhao [1 ]
Wang, Zhangyi [1 ]
Zhang, Zufan [1 ,2 ,3 ]
Zhu, Qingyi [4 ]
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing 400065, Peoples R China
[2] Chongqing Key Lab Mobile Commun Technol, Chongqing 400065, Peoples R China
[3] Minist Educ, Engn Res Ctr Mobile Commun, Chongqing 400065, Peoples R China
[4] Chongqing Univ Posts & Telecommun, Sch Cyber Secur & Informat Law, Chongqing 400065, Peoples R China
关键词
Facial image; Facial expression recognition; Densely connected convolutional neural; network; Spatial attention; HISTOGRAM; FEATURES;
D O I
10.1016/j.imavis.2021.104342
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper is dedicated to eliminating the impact of redundant information from emotional-unrelated regions on facial expression recognition (FER). To this end, a densely connected convolutional neural network with hierarchical spatial attention is proposed. Specifically, it can adaptively locate salient regions and focus on the emotional related features so that the facial expressions can be represented more efficiently. This superior performance is also verified by some experiments. Experimental results reveal that the proposed method can distinguish facial expression more accurately than existing state-of-the-art methods.(c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 33 条
[11]   Facial Expression Recognition for Traumatic Brain Injured Patients [J].
Ilyas, Chaudhary Muhammad Aqdus ;
Haque, Mohammad A. ;
Rehm, Matthias ;
Nasrollahi, Kamal ;
Moeslund, Thomas B. .
VISAPP: PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL 4: VISAPP, 2018, :522-530
[12]   Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network [J].
Ji, Yanli ;
Hu, Yuhan ;
Yang, Yang ;
Shen, Fumin ;
Shen, Heng Tao .
NEUROCOMPUTING, 2019, 333 :231-239
[13]   Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition [J].
Jung, Heechul ;
Lee, Sihaeng ;
Yim, Junho ;
Park, Sunjeong ;
Kim, Junmo .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2983-2991
[14]  
Kumar Y, 2017, 2017 INTERNATIONAL CONFERENCE ON COMPUTING METHODOLOGIES AND COMMUNICATION (ICCMC), P1074, DOI 10.1109/ICCMC.2017.8282636
[15]   A Compact Deep Learning Model for Robust Facial Expression Recognition [J].
Kuo, Chieh-Ming ;
Lai, Shang-Hong ;
Sarkis, Michel .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :2202-2210
[16]   Reliable Crowdsourcing and Deep Locality-Preserving Learning for Unconstrained Facial Expression Recognition [J].
Li, Shan ;
Deng, Weihong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (01) :356-370
[17]  
Li W., 2019, P IEEE INT C AUT FAC, P1
[18]   Automatic Facial Expression Recognition System Using Deep Network-Based Data Fusion [J].
Majumder, Anima ;
Behera, Laxmidhar ;
Subramanian, Venkatesh K. .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (01) :103-114
[19]   FERAtt: Facial Expression Recognition with Attention Net [J].
Marrero Fernandez, Pedro D. ;
Guerrero Pena, Fidel A. ;
Ren, Tsang Ing ;
Cunha, Alexandre .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :837-846
[20]   INFERENCE OF ATTITUDES FROM NONVERBAL COMMUNICATION IN 2 CHANNELS [J].
MEHRABIAN, A ;
FERRIS, SR .
JOURNAL OF CONSULTING PSYCHOLOGY, 1967, 31 (03) :248-252