Smart Affect Monitoring With Wearables in the Wild: An Unobtrusive Mood-Aware Emotion Recognition System

被引:6
作者
Can, Yekta Said [1 ]
Ersoy, Cem [2 ]
机构
[1] Univ Augsburg, D-86159 Augsburg, Germany
[2] Bogazici Univ, TR-34342 Istanbul, Turkiye
关键词
Affective computing; deep learning; emotion recognition; physiological signals; wearable; ELECTRODERMAL ACTIVITY; CIRCUMPLEX MODEL; STRESS; OPTIMIZATION;
D O I
10.1109/TAFFC.2022.3232483
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Affective computing strives to recognize a person's affective state (e.g., emotion, mood) based on what can be observed. However, electroencephalogram (EEG) and video technologies have not been widely adopted for daily life affect monitoring due to obtrusiveness and privacy concerns. Although the connection between affective states and biophysical data collected with unobtrusive wrist-worn wearables in lab settings has been established successfully, the number of studies for affect recognition in the wild is still limited, and current methods have not yet provided the accuracy necessary for robust applications. In this study, we propose a smart mood-aware emotion detection method. The proposed emotion recognition method extracts the most distinctive features from the physiological data and adds the output of the automated mood detection system as an input to improve performance. The effect of the division of self-report scales into emotion classes is also investigated. The proposed system obtained higher emotion recognition accuracies than most in-the-wild studies when we tested it with the daily life data collected from 14 participants for one week.
引用
收藏
页码:2851 / 2863
页数:13
相关论文
共 51 条
[1]   Heartbeats classification using QRS and T waves autoregressive features and RR interval features [J].
Adnane, Mourad ;
Belouchrani, Adel .
EXPERT SYSTEMS, 2017, 34 (06)
[2]   Hybrid deep convolutional model-based emotion recognition using multiple physiological signals [J].
Akbulut, Fatma Patlar .
COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2022, 25 (15) :1678-1690
[3]   Towards an automatic early stress recognition system for office environments based on multimodal measurements: A review [J].
Alberdi, Ane ;
Aztiria, Asier ;
Basarab, Adrian .
JOURNAL OF BIOMEDICAL INFORMATICS, 2016, 59 :49-75
[4]   iAware: A Real-Time Emotional Biofeedback System Based on Physiological Signals [J].
Albraikan, Amani ;
Hafidh, Basim ;
El Saddik, Abdulmotaleb .
IEEE ACCESS, 2018, 6 :78780-78789
[5]   A Comparative Study of Arousal and Valence Dimensional Variations for Emotion Recognition Using Peripheral Physiological Signals Acquired from Wearable Sensors [J].
Alskafi, Feryal A. ;
Khandoker, Ahsan H. ;
Jelinek, Herbert F. .
2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, :1104-1107
[6]  
[Anonymous], 2006, GESTS International Transactions on Computer Science and Engineering
[7]  
[Anonymous], 2018, Activity Reduces Stress
[8]  
[Anonymous], 2018, Understanding the stress response
[9]  
Attarodi G., 2018, P COMPUT CARDIOL, P1
[10]   Real-Life Stress Level Monitoring Using Smart Bands in the Light of Contextual Information [J].
Can, Yekta Said ;
Chalabianloo, Niaz ;
Ekiz, Deniz ;
Fernandez-Alvarez, Javier ;
Repetto, Claudia ;
Riva, Giuseppe ;
Iles-Smith, Heather ;
Ersoy, Cem .
IEEE SENSORS JOURNAL, 2020, 20 (15) :8721-8730