Robustness comparison between the capsule network and the convolutional network for facial expression recognition

被引:9
|
作者
Li, Donghui [1 ,2 ,3 ]
Zhao, Xingcong [1 ,2 ,3 ]
Yuan, Guangjie [1 ,2 ,3 ]
Liu, Ying [4 ]
Liu, Guangyuan [1 ,2 ,3 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing, Peoples R China
[2] Southwest Univ, Inst Affect Comp & Informat Proc, Chongqing, Peoples R China
[3] Southwest Univ, Chongqing Key Lab Nonlinear Circuits & Intelligen, Chongqing, Peoples R China
[4] Southwest Univ, Sch Math & Stat, Chongqing, Peoples R China
基金
中国国家自然科学基金;
关键词
Facial expression recognition; Robustness; Capsule network; Deep learning; DEEP;
D O I
10.1007/s10489-020-01895-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important part of human-computer interactions, facial expression recognition has become a popular research topic in computer vision, pattern recognition, artificial intelligence and other fields. With the development of deep learning and convolutional neural networks, research on facial expression recognition has also made considerable progress. Because facial expressions vary in real environments, such as rotation, shifting, brightness changes, partial occlusion and noise with different intensities, research on the robustness of facial expression recognition is very important. A capsule network consists of capsules, which are groups of neurons, and these capsules can learn posture information through the dynamic routing mechanism. The length of a capsule represents the existence probability, and each neuron in a capsule represents posture information (e.g., position, size, orientation or a combination of these properties). Therefore, in this study, the robustness of the emerging capsule network (CapsNet) is comprehensively compares with that of the traditional convolutional neural network (CNN) and fully convolutional network (FCN) in facial expression recognition tasks. The simulation results based on the Cohn-Kanade (CK+) databases show that the capsule network is more robust than the other networks. Therefore, the capsule network has significant advantages over the other networks in facial expression recognition task in complex real-world environments.
引用
收藏
页码:2269 / 2278
页数:10
相关论文
共 50 条
  • [31] Multi pose facial expression recognition based on convolutional neural network
    Feng, Yongliang
    INTERNATIONAL JOURNAL OF BIOMETRICS, 2022, 14 (3-4) : 253 - 267
  • [32] Three convolutional neural network models for facial expression recognition in the wild
    Shao, Jie
    Qian, Yongsheng
    NEUROCOMPUTING, 2019, 355 : 82 - 92
  • [33] Identity-Aware Convolutional Neural Network for Facial Expression Recognition
    Meng, Zibo
    Liu, Ping
    Cai, Jie
    Han, Shizhong
    Tong, Yan
    2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, : 558 - 565
  • [34] Self-Difference Convolutional Neural Network for Facial Expression Recognition
    Liu, Leyuan
    Jiang, Rubin
    Huo, Jiao
    Chen, Jingying
    SENSORS, 2021, 21 (06)
  • [35] Fast and Efficient Facial Expression Recognition Using a Gabor Convolutional Network
    Jiang, Ping
    Wan, Bo
    Wang, Quan
    Wu, Jiang
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1954 - 1958
  • [36] Facial Expression Recognition Based on Random Forest and Convolutional Neural Network
    Wang, Yingying
    Li, Yibin
    Song, Yong
    Rong, Xuewen
    INFORMATION, 2019, 10 (12)
  • [37] Facial Expression Recognition using Convolutional Neural Network with Data Augmentation
    Ahmed, Tawsin Uddin
    Hossain, Sazzad
    Hossain, Mohammad Shahadat
    Ul Islam, Raihan
    Andersson, Karl
    2019 JOINT 8TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2019 3RD INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR) WITH INTERNATIONAL CONFERENCE ON ACTIVITY AND BEHAVIOR COMPUTING (ABC), 2019, : 336 - 341
  • [38] POOLING MAP ADAPTATION IN CONVOLUTIONAL NEURAL NETWORK FOR FACIAL EXPRESSION RECOGNITION
    Li, Zhiyuan
    Han, Shizhong
    Khan, Ahmed Shehab
    Cai, Jie
    Meng, Zibo
    O'Reilly, James
    Tong, Yan
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1108 - 1113
  • [39] Efficient Recognition of Facial Expression with Lightweight Octave Convolutional Neural Network
    Lai, Shou-Chuan
    Chen, Ching-Yi
    Li, Jian-Hong
    Chiu, Fu -Chien
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2022, 66 (04)
  • [40] Facial Expression Recognition Using Salient Features and Convolutional Neural Network
    Uddin, Md. Zia
    Khaksar, Weria
    Torresen, Jim
    IEEE ACCESS, 2017, 5 : 26146 - 26161