Performance analysis of Microsoft's and Google's Emotion Recognition API using pose-invariant faces

被引:15
作者
Khanal, Salik Ram [1 ,2 ]
Barroso, Joao [1 ,2 ]
Lopes, Nuno [2 ,3 ]
Sampaio, Jaime [2 ,3 ]
Filipe, Vitor [1 ,2 ]
机构
[1] INESC TEC, Vila Real, Portugal
[2] Univ Tras Os Montes & Alto Douro, Vila Real, Portugal
[3] CIDESD, Vila Real, Portugal
来源
PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON SOFTWARE DEVELOPMENT AND TECHNOLOGIES FOR ENHANCING ACCESSIBILITY AND FIGHTING INFO-EXCLUSION (DSAI 2018) | 2018年
关键词
Emotion Recognition; Microsoft Azure; Emotion API; Google Cloud Vision; Face API; Confusion Matrix;
D O I
10.1145/3218585.3224223
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Many cloud vision APIs are available on the internet to recognize emotion from facial images and video analysis. The capacity to recognize emotions under various poses is a fundamental requirement in the area of emotion recognition. In this paper, the performance of two famous emotion recognition APIs is evaluated under the facial images of various poses. The experiments were done with the public dataset containing 980 images of each type of five poses [full left, half-left, straight, half-right, and full-right] with the seven emotions (Anger, Afraid, Disgust, Happiness, Neutral, Sadness, Surprise). It has been discovered that overall recognition accuracy is best in Microsoft Azure for straight images, whereas the face detection capability is better in Google. The Microsoft did not detect almost any of the images with full left and full right profile, but Google detected almost all of them. The Microsoft API presents an average true positive value up to 60%, whereas Google presents the maximum true positive value 45.25%.
引用
收藏
页码:172 / 178
页数:7
相关论文
共 4 条
  • [1] Ekman P., 1980, J PERS SOC PSYCHOL, P1125
  • [2] Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order
    Lopes, Andre Teixeira
    de Aguiar, Edilson
    De Souza, Alberto F.
    Oliveira-Santos, Thiago
    [J]. PATTERN RECOGNITION, 2017, 61 : 610 - 628
  • [3] Lundqvist D., 1998, KAROLINSKA DIRECTED
  • [4] Spiers D. L., 2015, FACAIL EMOTION DETEC