A Survey on Physiological Signal-Based Emotion Recognition

被引:24
作者
Ahmad, Zeeshan [1 ]
Khan, Naimul [1 ]
机构
[1] Toronto Metropolitan Univ, Dept Elect Comp & Biomed Engn, Toronto, ON M5B 2K3, Canada
来源
BIOENGINEERING-BASEL | 2022年 / 9卷 / 11期
关键词
data annotation; physiological signals; data variability; emotion models; challenges; review;
D O I
10.3390/bioengineering9110688
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
Physiological signals are the most reliable form of signals for emotion recognition, as they cannot be controlled deliberately by the subject. Existing review papers on emotion recognition based on physiological signals surveyed only the regular steps involved in the workflow of emotion recognition such as pre-processing, feature extraction, and classification. While these are important steps, such steps are required for any signal processing application. Emotion recognition poses its own set of challenges that are very important to address for a robust system. Thus, to bridge the gap in the existing literature, in this paper, we review the effect of inter-subject data variance on emotion recognition, important data annotation techniques for emotion recognition and their comparison, data pre-processing techniques for each physiological signal, data splitting techniques for improving the generalization of emotion recognition models and different multimodal fusion techniques and their comparison. Finally, we discuss key challenges and future directions in this field.
引用
收藏
页数:25
相关论文
共 117 条
[1]   ECG HEART-BEAT CLASSIFICATION USING MULTIMODAL IMAGE FUSION [J].
Ahmad, Zeeshan ;
Tabassum, Anika ;
Guan, Ling ;
Khan, Naimul .
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, :1330-1334
[2]   ECG Heartbeat Classification Using Multimodal Fusion [J].
Ahmad, Zeeshan ;
Tabassum, Anika ;
Guan, Ling ;
Khan, Naimul Mefraz .
IEEE ACCESS, 2021, 9 :100615-100626
[3]  
Ahmad Z, 2020, IEEE ENG MED BIO, P4518, DOI 10.1109/EMBC44109.2020.9176590
[4]   Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers [J].
Akcay, Mehmet Berkehan ;
Oguz, Kaya .
SPEECH COMMUNICATION, 2020, 116 :56-76
[5]   Classification of Paroxysmal and Persistent Atrial Fibrillation in Ambulatory ECG Recordings [J].
Alcaraz, Raul ;
Sandberg, Frida ;
Sornmo, Leif ;
Rieta, Jose Joaquin .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2011, 58 (05) :1441-1449
[6]   Examining Human-Horse Interaction by Means of Affect Recognition via Physiological Signals [J].
Althobaiti, Turke ;
Katsigiannis, Stamos ;
West, Daune ;
Ramzan, Naeem .
IEEE ACCESS, 2019, 7 :77857-77867
[7]  
[Anonymous], 2008, Honest Signals, DOI DOI 10.7551/MITPRESS/8022.001.0001
[8]  
[Anonymous], 2000, P ISCA TUT RES WORKS
[9]  
Bigirimana AD, 2016, IEEE SYS MAN CYBERN, P4429, DOI 10.1109/SMC.2016.7844928
[10]  
Bizzego A, 2021, BIOENGINEERING-BASEL, V8, DOI [10.3390/bioengineering8030035, 10.3390/bioengineering8030000]