A systematic review of emotion recognition using cardio-based signals

被引:7
作者
Ismail, Sharifah Noor Masidayu Sayed [1 ]
Aziz, Nor Azlina Ab. [2 ]
Ibrahim, Siti Zainab [3 ]
Mohamad, Mohd Saberi [4 ]
机构
[1] Multimedia Univ, Fac Informat Sci & Technol, Melaka, Malaysia
[2] Multimedia Univ, Fac Engn & Technol, Melaka, Malaysia
[3] Albukhary Int Univ AIU, Sch Informat & Comp, Kedah, Malaysia
[4] United Arab Emirates Univ, Coll Med & Hlth Sci, Hlth Data Sci Lab, Abu Dhabi, U Arab Emirates
关键词
Emotion recognition system; Electrocardiogram; Photoplethysmogram; Features extraction; Machine learning; Artificial intelligence; GSR SIGNALS; BIO-SIGNAL; ECG; CLASSIFICATION; DATABASE; PPG; EXPRESSIONS; FUSION; EEG;
D O I
10.1016/j.icte.2023.09.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There is a growing demand for emotion recognition systems (ERS) to be adopted in everyday life from various fields, particularly automotive, education, and social security. Recently, the use of cardio-based physiological signals, electrocardiogram (ECG), and photoplethysmogram (PPG) in ERS has yielded promising results. Furthermore, the development of wearable devices equipped with cardio-based physiological sensors has significantly aided towards the adoption of ERS in daily life. This paper systematically reviews emotion recognition using cardio-based physiological signals, encompassing emotion models, emotion elicitation methods, and ERS development methods, emphasizing feature extraction, feature selection methods, feature dimension reduction methods, and classifiers. A summary and comparison of recent studies are presented to highlight existing studies' gaps and suggest future research for better ERS especially using cardio-based signals. (c) 2023 The Author(s). Published by Elsevier B.V. on behalf of The Korean Institute of Communications and Information Sciences. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:156 / 183
页数:28
相关论文
共 134 条
[1]   Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research [J].
Ab Aziz, Nor Azlina ;
Tawsif, K. ;
Ismail, Sharifah Noor Masidayu Sayed ;
Hasnul, Muhammad Anas ;
Ab Aziz, Kamarulzaman ;
Ibrahim, Siti Zainab ;
Abd Aziz, Azlan ;
Raja, J. Emerson .
ALGORITHMS, 2023, 16 (03)
[2]   DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses [J].
Abadi, Mojtaba Khomami ;
Subramanian, Ramanathan ;
Kia, Seyed Mostafa ;
Avesani, Paolo ;
Patras, Ioannis ;
Sebe, Nicu .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2015, 6 (03) :209-222
[3]   ECG Pattern Analysis for Emotion Detection [J].
Agrafioti, Foteini ;
Hatzinakos, Dimitrios ;
Anderson, Adam K. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) :102-115
[4]   Design and Development of a Non-Contact ECG-Based Human Emotion Recognition System Using SVM and RF Classifiers [J].
Alam, Aftab ;
Urooj, Shabana ;
Ansari, Abdul Quaiyum .
DIAGNOSTICS, 2023, 13 (12)
[5]   Evaluating different configurations of machine learning models and their transfer learning capabilities for stress detection using heart rate [J].
Albaladejo-González M. ;
Ruipérez-Valiente J.A. ;
Gómez Mármol F. .
Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (08) :11011-11021
[6]   Examining Human-Horse Interaction by Means of Affect Recognition via Physiological Signals [J].
Althobaiti, Turke ;
Katsigiannis, Stamos ;
West, Daune ;
Ramzan, Naeem .
IEEE ACCESS, 2019, 7 :77857-77867
[7]   Detecting Naturalistic Expressions of Nonbasic Affect Using Physiological Signals [J].
AlZoubi, Omar ;
D'Mello, Sidney K. ;
Calvo, Rafael A. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (03) :298-310
[8]   Effect on speech emotion classification of a feature selection approach using a convolutional neural network [J].
Amjad, Ammar ;
Khan, Lal ;
Chang, Hsien-Tsung .
PEERJ COMPUTER SCIENCE, 2021, 7
[9]   Classification of Emotional Arousal During Multimedia Exposure [J].
Anderson, Adam ;
Hsiao, Thomas ;
Metsis, Vangelis .
10TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2017), 2017, :181-184
[10]   Emotion Recognition from Multimodal Physiological Signals for Emotion Aware Healthcare Systems [J].
Ayata, Deger ;
Yaslan, Yusuf ;
Kamasak, Mustafa E. .
JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2020, 40 (02) :149-157