NEMO: A Database for Emotion Analysis Using Functional Near-Infrared Spectroscopy

被引:2
作者
Spape, Michiel [1 ,2 ]
Makela, Kalle [1 ]
Ruotsalo, Tuukka [3 ,4 ]
机构
[1] Univ Helsinki, Helsinki 00100, Finland
[2] Univ Macau, ICI CCBS, Macau 999078, Peoples R China
[3] Univ Copenhagen, DK-1172 Copenhagen, Denmark
[4] LUT Univ, Lappeenranta 53850, Finland
基金
欧盟地平线“2020”; 芬兰科学院;
关键词
Affective computing; emotion classification; FNIRS; functional near-infrared spectroscopy; pattern classification; signal processing; FRONTAL EEG ASYMMETRY; ACTIVATION; HISTORY; CORTEX; FNIRS;
D O I
10.1109/TAFFC.2023.3315971
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a dataset for the analysis of human affective states using functional near-infrared spectroscopy (fNIRS). Data were recorded from thirty-one participants who engaged in two tasks. In the emotional perception task the participants passively viewed images sampled from the standard international affective picture system database, which provided ground-truth valence and arousal annotation for the stimuli. In the affective imagery task the participants actively imagined emotional scenarios followed by rating these for subjective valence and arousal. Correlates between the fNIRS signal and the valence-arousal ratings were investigated to estimate the validity of the dataset. Source-code and summaries are provided for a processing pipeline, brain activity group analysis, and estimating baseline classification performance. For classification, prediction experiments are conducted for single-trial 4-class classification of arousal and valence as well as cross-participant classifications, and comparisons between high and low arousal variants of the valence prediction tasks. Finally, classification results are presented for subject-specific and cross-participant models. The dataset is made publicly available to encourage research on affective decoding and downstream applications using fNIRS data.
引用
收藏
页码:1166 / 1177
页数:12
相关论文
共 66 条
[1]   DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses [J].
Abadi, Mojtaba Khomami ;
Subramanian, Ramanathan ;
Kia, Seyed Mostafa ;
Avesani, Paolo ;
Patras, Ioannis ;
Sebe, Nicu .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2015, 6 (03) :209-222
[2]  
ADOLPHS R, 1995, J NEUROSCI, V15, P5879
[3]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[4]   Issues and assumptions on the road from raw signals to metrics of frontal EEG asymmetry in emotion [J].
Allen, JJB ;
Coan, JA ;
Nazarian, M .
BIOLOGICAL PSYCHOLOGY, 2004, 67 (1-2) :183-218
[5]  
Ayaz H., 2019, Neuroergonomics, P17, DOI [10.1016/b978-0-12-811926-6.00003-8, DOI 10.1016/B978-0-12-811926-6.00003-8]
[6]   What hemodynamic (fNIRS), electrophysiological (EEG) and autonomic integrated measures can tell us about emotional processing [J].
Balconi, Michela ;
Grippa, Elisabetta ;
Vanutelli, Maria Elide .
BRAIN AND COGNITION, 2015, 95 :67-76
[7]   Extracting relevance and affect information from physiological text annotation [J].
Barral, Oswald ;
Kosunen, Ilkka ;
Ruotsalo, Tuukka ;
Spape, Michiel M. ;
Eugster, Manuel J. A. ;
Ravaja, Niklas ;
Kaski, Samuel ;
Jacucci, Giulio .
USER MODELING AND USER-ADAPTED INTERACTION, 2016, 26 (05) :493-520
[8]  
Barrett LF, 2008, EMBODIED GROUNDING: SOCIAL, COGNITIVE, AFFECTIVE, AND NEUROSCIENTIFIC APPROACHES, P237
[9]  
Bergstra J., 2011, ADV NEURAL INFORM PR, V24, P2546, DOI DOI 10.5555/2986459.2986743
[10]  
Bradley M. M., 2007, Handbook of emotion elicitation and assessment, P29, DOI DOI 10.1093/OSO/9780195169157.003.0003