Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network

被引:58
作者
Ji, Yanli [1 ]
Hu, Yuhan [1 ]
Yang, Yang [1 ]
Shen, Fumin [1 ]
Shen, Heng Tao [1 ]
机构
[1] Univ Elect Sci & Technol China, Ctr Future Media, Sch Comp Sci Engn, Chengdu, Sichuan, Peoples R China
关键词
Facial expression recognition; Cross-domain recognition; Deep learning; ICID fusion network;
D O I
10.1016/j.neucom.2018.12.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Facial expression recognition is crucial for various human-robot interaction applications, which requires facial expression analysis having a broad generalization. However, existing researches focus on the recognition in databases containing a limited number of samples. In this paper, we propose a novel feature fusion network for facial expression recognition in a cross-domain manner in order to realize the facial expression recognition in extensive scenarios. The proposed network consists of an Intra-category Common feature representation (IC) channel and an Inter-category Distinction feature representation (ID) channel for facial expression representation, and finally combine learned features of the two channels for facial expression recognition in cross databases. The IC channel learns the common features of intra-category facial expressions, and the ID channel learns the characteristic features of different categories. We evaluate the proposed approach in various experiment settings for cross-domain recognition, and achieves the state-of-the-art performances. We also evaluate the proposed approach for expression recognition in single databases, and also obtains the outstanding performance in the CK+, MMI, SFEW and RAF databases. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:231 / 239
页数:9
相关论文
共 52 条
  • [41] Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order
    Lopes, Andre Teixeira
    de Aguiar, Edilson
    De Souza, Alberto F.
    Oliveira-Santos, Thiago
    [J]. PATTERN RECOGNITION, 2017, 61 : 610 - 628
  • [42] Automatic classification of single facial images
    Lyons, MJ
    Budynek, J
    Akamatsu, S
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (12) : 1357 - 1362
  • [43] Mayer C., 2014, Pattern Recognition and Image Analysis, V24, P124
  • [44] CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition
    Qu, Fangbing
    Wang, Su-Jing
    Yan, Wen-Jing
    Li, He
    Wu, Shuhang
    Fu, Xiaolan
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2018, 9 (04) : 424 - 436
  • [45] Local Directional Ternary Pattern for Facial Expression Recognition
    Ryu, Byungyong
    Rivera, Adin Ramirez
    Kim, Jaemyun
    Chae, Oksam
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (12) : 6006 - 6018
  • [46] Facial expression recognition based on Local Binary Patterns: A comprehensive study
    Shan, Caifeng
    Gong, Shaogang
    McOwan, Peter W.
    [J]. IMAGE AND VISION COMPUTING, 2009, 27 (06) : 803 - 816
  • [47] An efficient unconstrained facial expression recognition algorithm based on Stack Binarized Auto-encoders and Binarized Neural Networks
    Sun, Wenyun
    Zhao, Haitao
    Jin, Zhong
    [J]. NEUROCOMPUTING, 2017, 267 : 385 - 395
  • [48] Facial action unit recognition by exploiting their dynamic and semantic relationships
    Tong, Yan
    Liao, Wenhui
    Ji, Qiang
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (10) : 1683 - 1699
  • [49] Walecki R, 2015, IEEE INT CONF AUTOMA
  • [50] Cross-Scenario Transfer Person Reidentification
    Wang, Xiaojuan
    Zheng, Wei-Shi
    Li, Xiang
    Zhang, Jianguo
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (08) : 1447 - 1460