A survey on facial emotion recognition techniques: A state-of-the-art literature review

被引:177
作者
Canal, Felipe Zago [1 ]
Mueller, Tobias Rossi [1 ]
Matias, Jhennifer Cristine [1 ]
Scotton, Gustavo Gino [1 ]
de Sa, Antonio Reis [3 ]
Pozzebon, Eliane [1 ,2 ]
Sobieranski, Antonio Carlos [1 ,2 ]
机构
[1] Univ Fed Santa Catarina, Dept Comp DEC, 3201 Gov Jorge Lacerda, Ararangua, SC, Brazil
[2] Univ Fed Santa Catarina, Post Grad Program Informat Technol & Commun PPGTI, 150 Pedro Joao Pereira, Ararangua, SC, Brazil
[3] Univ Fed Santa Catarina, Dept Med Clin DCM, Campus Univ, Florianopolis, SC, Brazil
关键词
Emotion Recognition; Facial emotion recognition; Pattern recognition; Systematic literature review; SUPPORT VECTOR MACHINE; EXPRESSION RECOGNITION; IMAGE; FACES; CLASSIFICATION; REPRESENTATION; VALIDATION; EXTRACTION; FEATURES;
D O I
10.1016/j.ins.2021.10.005
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this survey, a systematic literature review of the state-of-the-art on emotion expression recognition from facial images is presented. The paper has as main objective arise the most commonly used strategies employed to interpret and recognize facial emotion expressions, published over the past few years. For this purpose, a total of 51 papers were analyzed over the literature totaling 94 distinct methods, collected from well-established scientific data -bases (ACM Digital Library, IEEE Xplore, Science Direct and Scopus), whose works were cat-egorized according to its main construction concept. From the analyzed works, it was possible to categorize them into two main trends: classical and those approaches specifi-cally designed by the use of neural networks. The obtained statistical analysis demon-strated a marginally better recognition precision for the classical approaches when faced to neural networks counterpart, but with a reduced capacity of generalization. Additionally, the present study verified the most popular datasets for facial expression and emotion recognition showing the pros and cons each and, thereby, demonstrating a real demand for reliable data-sources regarding artificial and natural experimental environments. (c) 2021 Elsevier Inc. All rights reserved.
引用
收藏
页码:593 / 617
页数:25
相关论文
共 124 条
[1]  
Albawi S., 2017, 2017 INT C ENG TECHN, P1, DOI [10.1109/ICEngTechnol.2017.8308186, DOI 10.1109/ICENGTECHNOL.2017.8308186]
[2]   Boosted NNE collections for multicultural facial expression recognition [J].
Ali, Ghulam ;
Iqbal, Muhammad Amjad ;
Choi, Tae-Sun .
PATTERN RECOGNITION, 2016, 55 :14-27
[3]   Facial emotion recognition using empirical mode decomposition [J].
Ali, Hasimah ;
Hariharan, Muthusamy ;
Yaacob, Sazali ;
Adom, Abdul Hamid .
EXPERT SYSTEMS WITH APPLICATIONS, 2015, 42 (03) :1261-1277
[4]  
Alvarez VM, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON RESEARCH IN INTELLIGENT AND COMPUTING IN ENGINEERING (RICE III)
[5]  
Anila S., 2012, Global Journal of Computer Science and Technology Graphics & Vision
[6]  
[Anonymous], 2001, PROC CVPR IEEE
[7]  
[Anonymous], 2012, ARXIV12066875
[8]  
[Anonymous], 2018, CoRR abs/1804.08348
[9]  
[Anonymous], 2017, P 2 INT C COMP COMM
[10]  
[Anonymous], P 4 INT C GEN ALG IC