Eyebrow emotional expression recognition using surface EMG signals

被引:45
作者
Chen, Yumiao [1 ]
Yang, Zhongliang [2 ]
Wang, Jiangping [1 ]
机构
[1] Donghua Univ, Fash Inst, Shanghai 200051, Peoples R China
[2] Donghua Univ, Coll Mech Engn, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
Eyebrow; Facial expression recognition; Surface electromyography; Elman neural network; FACIAL EXPRESSION;
D O I
10.1016/j.neucom.2015.05.037
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The main objective of this study is to recognize facial emotional expression effectively in human-computer interaction. A surface electromyography (sEMG) based eyebrow emotional expression recognition method is proposed. Using a specially designed headband, we conducted an experiment in which we recorded the sEMG signals from the frontalis and corrugator supercilii muscles of six participants who were instructed to pose the facial expressions of anger, fear, sadness, surprise and disgust. Subsequently, six features of the sEMG time domain were extracted and used as input vectors to an emotion recognition model based on an Elman neural network (ENN). The performance of this model was compared to another recognition model based on a Back Propagation neural network (BPNN). The average recognition rate for the five emotions achieved by the ENN-based model was 97.12% in the training and 96.12% in the test set, which was slightly superior to the performance of the BPNN-based model. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:871 / 879
页数:9
相关论文
共 59 条
[1]   Simultaneous recording of EEG and facial muscle reactions during spontaneous emotional mimicry [J].
Achaibou, Amal ;
Pourtois, Gilles ;
Schwartz, Sophie ;
Vuilleumier, Patrik .
NEUROPSYCHOLOGIA, 2008, 46 (04) :1104-1113
[2]  
Ahsan R, 2009, EUR J SCI RES, V33, P480
[3]  
Anitha C., 2010, International Journal of Engineering Science and Technology, V2, P5158
[4]  
[Anonymous], P IEEE INT C IM PROC
[5]  
[Anonymous], 1983, EMFACS 7 EMOTIONAL F
[6]  
[Anonymous], 2000, CHINA SPORT SCI
[7]   Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks [J].
Ardalani-Farsa, Muhammad ;
Zolfaghari, Saeed .
NEUROCOMPUTING, 2010, 73 (13-15) :2540-2553
[8]  
Bartlett M. S., 2003, 2003 C COMP VIS PATT, V5, P53, DOI DOI 10.1109/CVPRW.2003.10057
[9]   Featural processing in recognition of emotional facial expressions [J].
Beaudry, Olivia ;
Roy-Charland, Annie ;
Perron, Melanie ;
Cormier, Isabelle ;
Tapp, Roxane .
COGNITION & EMOTION, 2014, 28 (03) :416-432
[10]   An approach to automatic recognition of spontaneous facial actions [J].
Braathen, B ;
Bartlett, MS ;
Littlewort, G ;
Smith, E ;
Movellan, JR .
FIFTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2002, :360-365