A ROI-guided deep architecture for robust facial expressions recognition

被引:26
作者
Sun, Xiao [1 ]
Xia, Pingping [1 ]
Zhang, Luming [2 ]
Shao, Ling [3 ]
机构
[1] Hefei Univ Technol, Sch Comp & Informat, Hefei, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci, Hangzhou, Zhejiang, Peoples R China
[3] Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
基金
中国国家自然科学基金;
关键词
Convolutional neural network; Facial expression recognition; Region of interest; Artificial face; REPRESENTATION; ENSEMBLE;
D O I
10.1016/j.ins.2020.02.047
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work proposes a robust facial expression recognition framework, focusing on discovering the region of interest (ROI) to train an effective face-specific of convolutional neural networks (CNN). By exploiting the relationships among ROI areas, the proposed deep architecture can improve the reliability of predicted targets. Our designed deep model is fine-tuned based on a pre-specified deep CNN instead of a new one trained from scratch. To increase the face expressions toward a robust deep CNN training, a novel data augmentation strategy called artificial face is designed. The performance of our deep architecture is evaluated on state-of-the-art databases such as CK+. To demonstrate the high generalizability of our approach, cross-database validations are conducted on the JAFFE and our own compiled Wild database. Comprehensive experiments have demonstrated the superiority of the method, i.e., achieving a recognition accuracy of 94.67% on the CK+ database, 53.77% on the JAFFE cross-database, 40.13% on the FER-2013 cross-database, and 37.25% on the Wild cross-database respectively. (C) 2020 Elsevier Inc. All rights reserved.
引用
收藏
页码:35 / 48
页数:14
相关论文
共 44 条
  • [1] Random Ordinality Ensembles: Ensemble methods for multi-valued categorical data
    Ahmad, Amir
    Brown, Gavin
    [J]. INFORMATION SCIENCES, 2015, 296 : 75 - 94
  • [2] [Anonymous], P CVPR
  • [3] [Anonymous], MINIMUM BOUNDING REC
  • [4] [Anonymous], 2015, DEEP CONVOLUTIONAL N
  • [5] [Anonymous], HDB FACE RECOGNITION
  • [6] [Anonymous], ACTA AUTOMATICA SINI
  • [7] [Anonymous], 2017, COMMUN ACM, DOI DOI 10.1145/3065386
  • [8] [Anonymous], CROSS DATABASE EVALU
  • [9] [Anonymous], COMPUT SCI
  • [10] [Anonymous], IEEE T CYBERNET