Emotion Recognition From EEG Using Higher Order Crossings

被引:469
作者
Petrantonakis, Panagiotis C. [1 ]
Hadjileontiadis, Leontios J. [1 ]
机构
[1] Aristotle Univ Thessaloniki, Signal Proc & Biomed Technol Unit, Telecommun Lab, Dept Elect & Comp Engn, GR-54124 Thessaloniki, Greece
来源
IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE | 2010年 / 14卷 / 02期
关键词
Electroencephalogram (EEG); emotion recognition; higher order crossings analysis; k-nearest neighbor (k-NN); Mahalanobis distance (MD); mirror neuron system; quadratic discriminant analysis; support vector machines (SVMs);
D O I
10.1109/TITB.2009.2034649
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Electroencephalogram (EEG)-based emotion recognition is a relatively new field in the affective computing area with challenging issues regarding the induction of the emotional states and the extraction of the features in order to achieve optimum classification performance. In this paper, a novel emotion evocation and EEG-based feature extraction technique is presented. In particular, the mirror neuron system concept was adapted to efficiently foster emotion induction by the process of imitation. In addition, higher order crossings (HOC) analysis was employed for the feature extraction scheme and a robust classification method, namely HOC-emotion classifier (HOC-EC), was implemented testing four different classifiers [quadratic discriminant analysis (QDA), k-nearest neighbor, Mahalanobis distance, and support vector machines (SVMs)], in order to accomplish efficient emotion recognition. Through a series of facial expression image projection, EEG data have been collected by 16 healthy subjects using only 3 EEG channels, namely Fp1, Fp2, and a bipolar channel of F3 and F4 positions according to 10-20 system. Two scenarios were examined using EEG data from a single-channel and from combined-channels, respectively. Compared with other feature extractionmethods, HOC-EC appears to outperform them, achieving a 62.3% (usingQDA) and 83.33% (usingSVM) classification accuracy for the single-channel and combined-channel cases, respectively, differentiating among the six basic emotions, i.e., happiness, surprise, anger, fear, disgust, and sadness. As the emotion class-set reduces its dimension, the HOC-EC converges toward maximum classification rate (100% for five or less emotions), justifying the efficiency of the proposed approach. This could facilitate the integration of HOC-EC in human machine interfaces, such as pervasive healthcare systems, enhancing their affective character and providing information about the user's emotional status (e.g., identifying user's emotion experiences, recurring affective states, time-dependent emotional trends).
引用
收藏
页码:186 / 197
页数:12
相关论文
共 43 条
[1]  
Addison PS, 2002, The illustrated wavelet transform handbook: introductory theory and applications in science
[2]  
[Anonymous], NEUR INF PROC SYST N
[3]  
[Anonymous], 1936, P NATL I SCI INDIA, DOI DOI 10.1007/S13171-019-00164-5
[4]  
[Anonymous], 2004, 6 INT C MULTIMODAL I
[5]  
[Anonymous], 2004, P 2 INT C AUT ROB AG
[6]  
[Anonymous], 2005, Technical Report A-6
[7]  
[Anonymous], 1988, Principles of Multivariate Analysis
[8]  
[Anonymous], 1997, MACHINE LEARNING, MCGRAW-HILL SCIENCE/ENGINEERING/MATH
[9]   Health-status monitoring through analysis of behavioral patterns [J].
Barger, TS ;
Brown, DE ;
Alwan, M .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2005, 35 (01) :22-27
[10]   Robust facial expression recognition using a state-based model of spatially-localised facial dynamics [J].
Bourel, F ;
Chibelushi, CC ;
Low, AA .
FIFTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, 2002, :113-118