Automatic ECG-Based Emotion Recognition in Music Listening

被引:136
作者
Hsu, Yu-Liang [1 ]
Wang, Jeen-Shing [2 ]
Chiang, Wei-Chun [2 ]
Hung, Chien-Han [2 ]
机构
[1] Feng Chia Univ, Dept Automat Control Engn, Taichung 40724, Taiwan
[2] Natl Cheng Kung Univ, Dept Elect Engn, Tainan 701, Taiwan
关键词
Electrocardiography; Music; Emotion recognition; Physiology; Feature extraction; Multiple signal classification; Algorithm design and analysis; Electrocardiogram; emotion recognition; music; machine learning; HEART-RATE-VARIABILITY; CIRCUMPLEX MODEL; ELECTROCARDIOGRAM; CLASSIFICATION; EXTRACTION; ALGORITHM; FREQUENCY; SELECTION; DYNAMICS;
D O I
10.1109/TAFFC.2017.2781732
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an automatic ECG-based emotion recognition algorithm for human emotion recognition. First, we adopt a musical induction method to induce participants' real emotional states and collect their ECG signals without any deliberate laboratory setting. Afterward, we develop an automatic ECG-based emotion recognition algorithm to recognize human emotions elicited by listening to music. Physiological ECG features extracted from the time-, and frequency-domain, and nonlinear analyses of ECG signals are used to find emotion-relevant features and to correlate them with emotional states. Subsequently, we develop a sequential forward floating selection-kernel-based class separability-based (SFFS-KBCS-based) feature selection algorithm and utilize the generalized discriminant analysis (GDA) to effectively select significant ECG features associated with emotions and to reduce the dimensions of the selected features, respectively. Positive/negative valence, high/low arousal, and four types of emotions (joy, tension, sadness, and peacefulness) are recognized using least squares support vector machine (LS-SVM) recognizers. The results show that the correct classification rates for positive/negative valence, high/low arousal, and four types of emotion classification tasks are 82.78, 72.91, and 61.52 percent, respectively.
引用
收藏
页码:85 / 99
页数:15
相关论文
共 46 条
[1]   Heart rate variability: a review [J].
Acharya, U. Rajendra ;
Joseph, K. Paul ;
Kannathal, N. ;
Lim, Choo Min ;
Suri, Jasjit S. .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2006, 44 (12) :1031-1051
[2]   ECG Pattern Analysis for Emotion Detection [J].
Agrafioti, Foteini ;
Hatzinakos, Dimitrios ;
Anderson, Adam K. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :102-115
[3]  
[Anonymous], 2006, 2006 COMPUTERS CARDI
[4]   A robust method for ECG-Based estimation of the respiratory frequency during stress testing [J].
Bailon, Raquel ;
Sornmo, Leif ;
Laguna, Pablo .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2006, 53 (07) :1273-1285
[5]   Generalized discriminant analysis using a kernel approach [J].
Baudat, G ;
Anouar, FE .
NEURAL COMPUTATION, 2000, 12 (10) :2385-2404
[6]  
Camm AJ, 1996, CIRCULATION, V93, P1043
[7]   Automated processing of the single-lead electrocardiogram for the detection of obstructive sleep apnoea [J].
de Chazal, P ;
Heneghan, C ;
Sheridan, E ;
Reilly, R ;
Nolan, P ;
O'Malley, M .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2003, 50 (06) :686-696
[8]   Effects of central sympathetic inhibition on heart rate variability during steady-state exercise in healthy humans [J].
De Vito, G ;
Galloway, SDR ;
Nimmo, MA ;
Maas, P ;
McMurray, JJV .
CLINICAL PHYSIOLOGY AND FUNCTIONAL IMAGING, 2002, 22 (01) :32-38
[9]   AN ARGUMENT FOR BASIC EMOTIONS [J].
EKMAN, P .
COGNITION & EMOTION, 1992, 6 (3-4) :169-200
[10]  
Gabrielsson A, 2003, SER AFFECTIVE SCI, P503