Asian Affective and Emotional State (A2ES) Dataset of ECG and PPG for Affective Computing Research

被引:7
作者
Ab Aziz, Nor Azlina [1 ]
Tawsif, K. [1 ]
Ismail, Sharifah Noor Masidayu Sayed [2 ]
Hasnul, Muhammad Anas [1 ]
Ab Aziz, Kamarulzaman [3 ]
Ibrahim, Siti Zainab [4 ]
Abd Aziz, Azlan [1 ]
Raja, J. Emerson [1 ]
机构
[1] Multimedia Univ, Fac Engn & Technol, Bukit Beruang 75450, Melaka, Malaysia
[2] Multimedia Univ, Fac Informat Sci & Technol, Bukit Beruang 75450, Melaka, Malaysia
[3] Multimedia Univ, Fac Business, Bukit Beruang 75450, Melaka, Malaysia
[4] Albukhary Int Univ, Sch Comp & Informat, Jalan Tun Abdul Razak, Alor Setar 05200, Kedah, Malaysia
关键词
affective computing; emotion recognition system; physiological signals; ATRIAL-FIBRILLATION; RECOGNITION; DATABASE; DEVICES; SYSTEM;
D O I
10.3390/a16030130
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Affective computing focuses on instilling emotion awareness in machines. This area has attracted many researchers globally. However, the lack of an affective database based on physiological signals from the Asian continent has been reported. This is an important issue for ensuring inclusiveness and avoiding bias in this field. This paper introduces an emotion recognition database, the Asian Affective and Emotional State (A2ES) dataset, for affective computing research. The database comprises electrocardiogram (ECG) and photoplethysmography (PPG) recordings from 47 Asian participants of various ethnicities. The subjects were exposed to 25 carefully selected audio-visual stimuli to elicit specific targeted emotions. An analysis of the participants' self-assessment and a list of the 25 stimuli utilised are also presented in this work. Emotion recognition systems are built using ECG and PPG data; five machine learning algorithms: support vector machine (SVM), k-nearest neighbour (KNN), naive Bayes (NB), decision tree (DT), and random forest (RF); and deep learning techniques. The performance of the systems built are presented and compared. The SVM was found to be the best learning algorithm for the ECG data, while RF was the best for the PPG data. The proposed database is available to other researchers.
引用
收藏
页数:21
相关论文
共 70 条
[1]   DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses [J].
Abadi, Mojtaba Khomami ;
Subramanian, Ramanathan ;
Kia, Seyed Mostafa ;
Avesani, Paolo ;
Patras, Ioannis ;
Sebe, Nicu .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2015, 6 (03) :209-222
[2]   Using Wearable Physiological Sensors for Affect-Aware Intelligent Tutoring Systems [J].
Alqahtani, Fehaid ;
Katsigiannis, Stamos ;
Ramzan, Naeem .
IEEE SENSORS JOURNAL, 2021, 21 (03) :3366-3378
[3]  
[Anonymous], 2014, AUGSBURG BIOSIGNAL T
[4]  
[Anonymous], 2020, Deutsche Welle
[5]   Emotion Recognition from Multimodal Physiological Signals for Emotion Aware Healthcare Systems [J].
Ayata, Deger ;
Yaslan, Yusuf ;
Kamasak, Mustafa E. .
JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2020, 40 (02) :149-157
[6]   Recognition of positive and negative valence states in children with autism spectrum disorder (ASD) using discrete wavelet transform (DWT) analysis of electrocardiogram signals (ECG) [J].
Bagirathan, Anandhi ;
Selvaraj, Jerritta ;
Gurusamy, Anusuya ;
Das, Himangshu .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (01) :405-416
[7]   Towards real-time speech emotion recognition for affective e-learning [J].
Bahreini K. ;
Nadolski R. ;
Westera W. .
Education and Information Technologies, 2016, 21 (5) :1367-1386
[8]   Smartwatch Algorithm for Automated Detection of Atrial Fibrillation [J].
Bumgarner, Joseph M. ;
Lambert, Cameron T. ;
Hussein, Ayman A. ;
Cantillon, Daniel J. ;
Baranowski, Bryan ;
Wolski, Kathy ;
Lindsay, Bruce D. ;
Wazni, Oussama M. ;
Tarakji, Khaldoun G. .
JOURNAL OF THE AMERICAN COLLEGE OF CARDIOLOGY, 2018, 71 (21) :2381-2388
[9]   Emotion recognition based on fusion of long short-term memory networks and SVMs [J].
Chen, Tian ;
Yin, Hongfang ;
Yuan, Xiaohui ;
Gu, Yu ;
Ren, Fuji ;
Sun, Xiao .
DIGITAL SIGNAL PROCESSING, 2021, 117
[10]   Limiting racial disparities and bias for wearable devices in health science research [J].
Colvonen, Peter J. ;
DeYoung, Pamela N. ;
Bosompra, Naa-Oye A. ;
Owens, Robert L. .
SLEEP, 2020, 43 (10)