Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network

被引:58
作者
Ji, Yanli [1 ]
Hu, Yuhan [1 ]
Yang, Yang [1 ]
Shen, Fumin [1 ]
Shen, Heng Tao [1 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Future Media, Sch Comp Sci Engn, Chengdu, Sichuan, Peoples R China
关键词
Facial expression recognition; Cross-domain recognition; Deep learning; ICID fusion network;
D O I
10.1016/j.neucom.2018.12.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression recognition is crucial for various human-robot interaction applications, which requires facial expression analysis having a broad generalization. However, existing researches focus on the recognition in databases containing a limited number of samples. In this paper, we propose a novel feature fusion network for facial expression recognition in a cross-domain manner in order to realize the facial expression recognition in extensive scenarios. The proposed network consists of an Intra-category Common feature representation (IC) channel and an Inter-category Distinction feature representation (ID) channel for facial expression representation, and finally combine learned features of the two channels for facial expression recognition in cross databases. The IC channel learns the common features of intra-category facial expressions, and the ID channel learns the characteristic features of different categories. We evaluate the proposed approach in various experiment settings for cross-domain recognition, and achieves the state-of-the-art performances. We also evaluate the proposed approach for expression recognition in single databases, and also obtains the outstanding performance in the CK+, MMI, SFEW and RAF databases. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:231 / 239
页数:9
相关论文
共 52 条
  • [1] Multi-gradient features and elongated quinary pattern encoding for image-based facial expression recognition
    Al-Sumaidaee, S. A. M.
    Abdullah, M. A. M.
    Al-Nima, R. R. O.
    Dlay, S. S.
    Chambers, J. A.
    [J]. PATTERN RECOGNITION, 2017, 71 : 249 - 263
  • [2] [Anonymous], P ICCV
  • [3] [Anonymous], P IEEE INT C AUT FAC
  • [4] [Anonymous], 2015, 2015 11 IEEE INT C W
  • [5] [Anonymous], 2014, PROCEDIA IEEE COMPUT, DOI [DOI 10.1109/CVPR.2014.233, 10.1109/CVPR.2014.233]
  • [6] [Anonymous], 2017, P CVPR
  • [7] [Anonymous], P IEEE INT S ROB HUM
  • [8] [Anonymous], P IEEE INT C IM PROC
  • [9] [Anonymous], P IEEE WINT C APPL C
  • [10] [Anonymous], P IEEE INT C WORKSH