ECG Pattern Analysis for Emotion Detection

被引:341
作者
Agrafioti, Foteini [1 ]
Hatzinakos, Dimitrios [1 ]
Anderson, Adam K. [2 ]
机构
[1] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S 3G4, Canada
[2] Univ Toronto, Dept Psychol, Toronto, ON M5S 3G3, Canada
关键词
Electrocardiogram; emotion recognition; affective computing; arousal; valence; active stress; passive stress; bivariate empirical mode decomposition; intrinsic mode function; instantaneous frequency; oscillation; T-WAVE AMPLITUDE; MENTAL STRESS; HEART-RATE; INDEXES;
D O I
10.1109/T-AFFC.2011.28
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion modeling and recognition has drawn extensive attention from disciplines such as psychology, cognitive science, and, lately, engineering. Although a significant amount of research has been done on behavioral modalities, less explored characteristics include the physiological signals. This work brings to the table the ECG signal and presents a thorough analysis of its psychological properties. The fact that this signal has been established as a biometric characteristic calls for subject-dependent emotion recognizers that capture the instantaneous variability of the signal from its homeostatic baseline. A solution based on the empirical mode decomposition is proposed for the detection of dynamically evolving emotion patterns on ECG. Classification features are based on the instantaneous frequency (Hilbert-Huang transform) and the local oscillation within every mode. Two experimental setups are presented for the elicitation of active arousal and passive arousal/valence. The results support the expectations for subject specificity, as well as demonstrating the feasibility of determining valence out of the ECG morphology (up to 89 percent for 44 subjects). In addition, this work differentiates for the first time between active and passive arousal, and advocates that there are higher chances of ECG reactivity to emotion when the induction method is active for the subject.
引用
收藏
页码:102 / 115
页数:14
相关论文
共 49 条
[1]   Mental stress may induce QT-Interval prolongation and T-wave notching [J].
Andrassy, Gábor ;
Szabo, Attila ;
Ferencz, Gyöngyvér ;
Trummer, Zsófia ;
Simon, Eszter ;
Tahy, Adám .
ANNALS OF NONINVASIVE ELECTROCARDIOLOGY, 2007, 12 (03) :251-259
[2]  
[Anonymous], 2005, CHI '05: Proceedings of the SIGCHI conference on Human factors in computing systems
[3]  
[Anonymous], 2009, P IEEE 3 INT C BIOM
[4]  
[Anonymous], 2001, International affective picture system (IAPS): Instruction manual and affective ratings
[5]   AUTOMATIC DETECTION OF ECG WAVE BOUNDARIES USING EMPIRICAL MODE DECOMPOSITION [J].
Arafat, Md. Abdullah ;
Hasan, Md. Kamrul .
2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, :461-464
[6]   A novel approach of fast and adaptive bidimensional empirical mode decomposition [J].
Bhuiyan, Sharif M. A. ;
Adhami, Reza R. ;
Khan, Jesmin F. .
2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, :1313-1316
[7]   Fast and adaptive bidimensional empirical mode decomposition using order-statistics filter based envelope estimation [J].
Bhuiyan, Sharif M. A. ;
Adhami, Reza R. ;
Khan, Jesmin F. .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2008, 2008 (1)
[8]   ECG signal denoising and baseline wander correction based on the empirical mode decomposition [J].
Blanco-Velasco, Manuel ;
Weng, Binwei ;
Barner, Kenneth E. .
COMPUTERS IN BIOLOGY AND MEDICINE, 2008, 38 (01) :1-13
[9]   Predicting athletic performance from cardiovascular indexes of challenge and threat [J].
Blascovich, J ;
Seery, MD ;
Mugridge, CA ;
Norris, RK ;
Weisbuch, M .
JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2004, 40 (05) :683-688
[10]   PSYCHOLOGICAL PREDICTORS OF HEART-DISEASE - A QUANTITATIVE REVIEW [J].
BOOTHKEWLEY, S ;
FRIEDMAN, HS .
PSYCHOLOGICAL BULLETIN, 1987, 101 (03) :343-362