A survey of emotion recognition methods with emphasis on E-Learning environments

被引:94
作者
Imani, Maryam [1 ]
Montazer, Gholam Ali [2 ]
机构
[1] Tarbiat Modares Univ, Fac Elect & Comp Engn, Tehran, Iran
[2] Tarbiat Modares Univ, Fac Informat Technol Engn, Tehran, Iran
关键词
Emotion recognition; Facial expression; Body gesture; Speech; Physiological signal; Text; E-learning; FACIAL EXPRESSION RECOGNITION; ACHIEVEMENT EMOTIONS; INFORMATION-SEEKING; SPEAKER ADAPTATION; ACADEMIC EMOTIONS; FEATURE-SELECTION; SOCIAL COGNITION; FACE RECOGNITION; BINARY PATTERNS; NEURAL-NETWORKS;
D O I
10.1016/j.jnca.2019.102423
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Emotions play an important role in the learning process. Considering the learner's emotions is essential for electronic learning (e-learning) systems. Some researchers have proposed that system should induce and conduct the learner's emotions to the suitable state. But, at first, the learner's emotions have to be recognized by the system. There are different methods in the context of human emotions recognition. The emotions can be recognized by asking from the user, tracking implicit parameters, voice recognition, facial expression recognition, vital signals and gesture recognition. Moreover, hybrid methods have been also proposed which use two or more of these methods through fusing multi-modal emotional cues. In the e-learning systems, the system's user is the learner. For some reasons, which have been discussed in this study, some of the user emotions recognition methods are more suitable in the e-learning systems and some of them are inappropriate. In this work, different emotion theories are reviewed. Then, various emotions recognition methods have been represented and their advantages and disadvantages of them have been discussed for utilizing in the e-learning systems. According to the findings of this research, the multi-modal emotion recognition systems through information fusion as facial expressions, body gestures and user's messages provide better efficiency than the single-modal ones.
引用
收藏
页数:40
相关论文
共 408 条
[1]  
Abbas A., 2008, 2008 International Conference on Computer Engineering & Systems (ICCES '08), P59, DOI 10.1109/ICCES.2008.4772966
[2]   The role of Information and Communication Technologies in healthcare: taxonomies, perspectives, and challenges [J].
Aceto, Giuseppe ;
Persico, Valerio ;
Pescape, Antonio .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2018, 107 :125-154
[3]   Neural systems for recognizing emotion [J].
Adolphs, R .
CURRENT OPINION IN NEUROBIOLOGY, 2002, 12 (02) :169-177
[4]   Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications [J].
Adrian Corneanu, Ciprian ;
Oliu Simon, Marc ;
Cohn, Jeffrey F. ;
Escalera Guerrero, Sergio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) :1548-1568
[5]   A research agenda for physiological computing [J].
Allanson, J ;
Fairclough, SH .
INTERACTING WITH COMPUTERS, 2004, 16 (05) :857-878
[6]   Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition [J].
Almaev, Timur R. ;
Valstar, Michel F. .
2013 HUMAINE ASSOCIATION CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2013, :356-361
[7]   Regional Registration for Expression Resistant 3-D Face Recognition [J].
Alyuz, Nese ;
Gokberk, Berk ;
Akarun, Lale .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2010, 5 (03) :425-440
[8]   THIN SLICES OF EXPRESSIVE BEHAVIOR AS PREDICTORS OF INTERPERSONAL CONSEQUENCES - A METAANALYSIS [J].
AMBADY, N ;
ROSENTHAL, R .
PSYCHOLOGICAL BULLETIN, 1992, 111 (02) :256-274
[9]   Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011 [J].
Anagnostopoulos, Christos-Nikolaos ;
Iliou, Theodoros ;
Giannoukos, Ioannis .
ARTIFICIAL INTELLIGENCE REVIEW, 2015, 43 (02) :155-177
[10]  
[Anonymous], P AUD VIS SPEECH PRO