An Investigation of Olfactory-Enhanced Video on EEG-Based Emotion Recognition

被引:31
作者
Wu, Minchao [1 ,2 ]
Teng, Wei [1 ,2 ]
Fan, Cunhang [1 ,2 ]
Pei, Shengbing [1 ,2 ]
Li, Ping [1 ,2 ]
Lv, Zhao [1 ,2 ]
机构
[1] Anhui Univ, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[2] Anhui Univ, Sch Comp Sci & Technol, Hefei 230601, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography; Emotion recognition; Brain; Human computer interaction; Physiology; Visualization; Olfactory; Electroencephalogram (EEG); emotion recognition; human-computer interface (HCI); olfactory-enhanced video; neural pattern; CLASSIFICATION; BRAIN;
D O I
10.1109/TNSRE.2023.3253866
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Collecting emotional physiological signals is significant in building affective Human-Computer Interactions (HCI). However, how to evoke subjects' emotions efficiently in EEG-related emotional experiments is still a challenge. In this work, we developed a novel experimental paradigm that allows odors dynamically participate in different stages of video-evoked emotions, to investigate the efficiency of olfactory-enhanced videos in inducing subjects' emotions; According to the period that the odors participated in, the stimuli were divided into four patterns, i.e., the olfactory-enhanced video in early/later stimulus periods (OVEP/OVLP), and the traditional videos in early/later stimulus periods (TVEP/TVLP). The differential entropy (DE) feature and four classifiers were employed to test the efficiency of emotion recognition. The best average accuracies of the OVEP, OVLP, TVEP, and TVLP were 50.54%, 51.49%, 40.22%, and 57.55%, respectively. The experimental results indicated that the OVEP significantly outperformed the TVEP on classification performance, while there was no significant difference between the OVLP and TVLP. Besides, olfactory-enhanced videos achieved higher efficiency in evoking negative emotions than traditional videos. Moreover, we found that the neural patterns in response to emotions under different stimulus methods were stable, and for Fp1, FP2, and F7, there existed significant differences in whether adopt the odors.
引用
收藏
页码:1602 / 1613
页数:12
相关论文
共 50 条
[1]  
[Anonymous], 2006, PhD diss
[2]   Deep Learning Classification of Neuro-Emotional Phase Domain Complexity Levels Induced by Affective Video Film Clips [J].
Aydin, Serap .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (06) :1695-1702
[3]   Comparison of hemispheric asymmetry measurements for emotional recordings from controls [J].
Aydin, Serap ;
Demirtas, Serdar ;
Tunga, M. Alper ;
Ates, Kahraman .
NEURAL COMPUTING & APPLICATIONS, 2018, 30 (04) :1341-1351
[4]   Investigating Multisensory Integration in Emotion Recognition Through Bio-Inspired Computational Models [J].
Benssassi, Esma Mansouri ;
Ye, Juan .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (02) :906-918
[5]   Facial Expression Recognition in Video with Multiple Feature Fusion [J].
Chen, Junkai ;
Chen, Zenghai ;
Chi, Zheru ;
Fu, Hong .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2018, 9 (01) :38-50
[6]   Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy [J].
Combrisson, Etienne ;
Jerbi, Karim .
JOURNAL OF NEUROSCIENCE METHODS, 2015, 250 :126-136
[7]   The Experience of Empathy in Everyday Life [J].
Depow, Gregory John ;
Francis, Zoe ;
Inzlicht, Michael .
PSYCHOLOGICAL SCIENCE, 2021, 32 (08) :1198-1213
[8]   Approach-avoidance motivation in personality: Approach and avoidance temperaments and goals [J].
Elliot, AJ ;
Thrash, TM .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 2002, 82 (05) :804-818
[9]   Innovative approaches to examining consumer preferences when choosing wines [J].
Horska, Elena ;
Bercik, Jakub ;
Krasnodebski, Andrzej ;
Matysik-Pejas, Renata ;
Bakayova, Hana .
AGRICULTURAL ECONOMICS-ZEMEDELSKA EKONOMIKA, 2016, 62 (03) :124-133
[10]   Human emotion recognition from EEG-based brain-computer interface using machine learning: a comprehensive review [J].
Houssein, Essam H. ;
Hammad, Asmaa ;
Ali, Abdelmgeid A. .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (15) :12527-12557