A systematic review of emotion recognition using cardio-based signals

被引:7
作者
Ismail, Sharifah Noor Masidayu Sayed [1 ]
Aziz, Nor Azlina Ab. [2 ]
Ibrahim, Siti Zainab [3 ]
Mohamad, Mohd Saberi [4 ]
机构
[1] Multimedia Univ, Fac Informat Sci & Technol, Melaka, Malaysia
[2] Multimedia Univ, Fac Engn & Technol, Melaka, Malaysia
[3] Albukhary Int Univ AIU, Sch Informat & Comp, Kedah, Malaysia
[4] United Arab Emirates Univ, Coll Med & Hlth Sci, Hlth Data Sci Lab, Abu Dhabi, U Arab Emirates
关键词
Emotion recognition system; Electrocardiogram; Photoplethysmogram; Features extraction; Machine learning; Artificial intelligence; GSR SIGNALS; BIO-SIGNAL; ECG; CLASSIFICATION; DATABASE; PPG; EXPRESSIONS; FUSION; EEG;
D O I
10.1016/j.icte.2023.09.001
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There is a growing demand for emotion recognition systems (ERS) to be adopted in everyday life from various fields, particularly automotive, education, and social security. Recently, the use of cardio-based physiological signals, electrocardiogram (ECG), and photoplethysmogram (PPG) in ERS has yielded promising results. Furthermore, the development of wearable devices equipped with cardio-based physiological sensors has significantly aided towards the adoption of ERS in daily life. This paper systematically reviews emotion recognition using cardio-based physiological signals, encompassing emotion models, emotion elicitation methods, and ERS development methods, emphasizing feature extraction, feature selection methods, feature dimension reduction methods, and classifiers. A summary and comparison of recent studies are presented to highlight existing studies' gaps and suggest future research for better ERS especially using cardio-based signals. (c) 2023 The Author(s). Published by Elsevier B.V. on behalf of The Korean Institute of Communications and Information Sciences. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:156 / 183
页数:28
相关论文
共 134 条
[91]   Emotion Recognition Using Physiological Signals: Laboratory vs. Wearable Sensors [J].
Ragot, Martin ;
Martin, Nicolas ;
Em, Sonia ;
Pallamin, Nico ;
Diverrez, Jean-Marc .
ADVANCES IN HUMAN FACTORS IN WEARABLE TECHNOLOGIES AND GAME DESIGN (AHFE 2017), 2018, 608 :15-22
[92]   DEAR-MULSEMEDIA: Dataset for emotion analysis and recognition in response to multiple sensorial media [J].
Raheel, Aasim ;
Majid, Muhammad ;
Anwar, Syed Muhammad .
INFORMATION FUSION, 2021, 65 :37-49
[93]   Physiological Sensors Based Emotion Recognition While Experiencing Tactile Enhanced Multimedia [J].
Raheel, Aasim ;
Majid, Muhammad ;
Alnowami, Majdi ;
Anwar, Syed Muhammad .
SENSORS, 2020, 20 (14) :1-19
[94]  
Rakshit R., 2016, Emotion detection and recognition using HRV features derived from photoplethysmogram signals, P1, DOI [10.1145/3009960.3009962, DOI 10.1145/3009960.3009962]
[95]  
Ramirez Rafael, 2012, Brain Informatics. International Conference, BI 2012. Proceedings, P175, DOI 10.1007/978-3-642-35139-6_17
[96]   Emotion Recognition: Photoplethysmography and Electrocardiography in Comparison [J].
Rinella, Sergio ;
Massimino, Simona ;
Fallica, Piero Giorgio ;
Giacobbe, Alberto ;
Donato, Nicola ;
Coco, Marinella ;
Neri, Giovanni ;
Parenti, Rosalba ;
Perciavalle, Vincenzo ;
Conoci, Sabrina .
BIOSENSORS-BASEL, 2022, 12 (10)
[97]   Prediction of asynchronous dimensional emotion ratings from audiovisual and physiological data [J].
Ringeval, Fabien ;
Eyben, Florian ;
Kroupi, Eleni ;
Yuce, Anil ;
Thiran, Jean-Philippe ;
Ebrahimi, Touradj ;
Lalanne, Denis ;
Schueller, Bjoern .
PATTERN RECOGNITION LETTERS, 2015, 66 :22-30
[98]   Heart and Breathing Rate Variations as Biomarkers for Anxiety Detection [J].
Ritsert, Florian ;
Elgendi, Mohamed ;
Galli, Valeria ;
Menon, Carlo .
BIOENGINEERING-BASEL, 2022, 9 (11)
[99]   Unsupervised multi-modal representation learning for affective computing with multi-corpus wearable data [J].
Ross, Kyle ;
Hungler, Paul ;
Etemad, Ali .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 14 (4) :3199-3224
[100]   A CIRCUMPLEX MODEL OF AFFECT [J].
RUSSELL, JA .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1980, 39 (06) :1161-1178