NEMO: A Database for Emotion Analysis Using Functional Near-Infrared Spectroscopy

被引:0
|
作者
Spape, Michiel [1 ,2 ]
Makela, Kalle [1 ]
Ruotsalo, Tuukka [3 ,4 ]
机构
[1] Univ Helsinki, Helsinki 00100, Finland
[2] Univ Macau, ICI CCBS, Macau 999078, Peoples R China
[3] Univ Copenhagen, DK-1172 Copenhagen, Denmark
[4] LUT Univ, Lappeenranta 53850, Finland
基金
欧盟地平线“2020”; 芬兰科学院;
关键词
Affective computing; emotion classification; FNIRS; functional near-infrared spectroscopy; pattern classification; signal processing; FRONTAL EEG ASYMMETRY; ACTIVATION; HISTORY; CORTEX; FNIRS;
D O I
10.1109/TAFFC.2023.3315971
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a dataset for the analysis of human affective states using functional near-infrared spectroscopy (fNIRS). Data were recorded from thirty-one participants who engaged in two tasks. In the emotional perception task the participants passively viewed images sampled from the standard international affective picture system database, which provided ground-truth valence and arousal annotation for the stimuli. In the affective imagery task the participants actively imagined emotional scenarios followed by rating these for subjective valence and arousal. Correlates between the fNIRS signal and the valence-arousal ratings were investigated to estimate the validity of the dataset. Source-code and summaries are provided for a processing pipeline, brain activity group analysis, and estimating baseline classification performance. For classification, prediction experiments are conducted for single-trial 4-class classification of arousal and valence as well as cross-participant classifications, and comparisons between high and low arousal variants of the valence prediction tasks. Finally, classification results are presented for subject-specific and cross-participant models. The dataset is made publicly available to encourage research on affective decoding and downstream applications using fNIRS data.
引用
收藏
页码:1166 / 1177
页数:12
相关论文
共 50 条
  • [41] Interpolated functional manifold for functional near-infrared spectroscopy analysis at group level
    Avila-Sansores, Shender-Maria
    Rodriguez-Gomez, Gustavo
    Tachtsidis, Ilias
    Orihuela-Espina, Felipe
    NEUROPHOTONICS, 2020, 7 (04)
  • [42] Superficial Fluctuations in Functional Near-Infrared Spectroscopy
    Zhang, Fan
    Cheong, Daniel
    Chen, Yuxuan
    Khan, Ali
    Ding, Lei
    Yuan, Han
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 4779 - 4782
  • [43] Assessment of hemispheric differences in attention with functional near-infrared spectroscopy
    Dolu, Nazan
    Altinkaynak, Miray
    Pektas, Ferhat
    Yildiz, Sacide
    Guven, Aysegul
    Izzetoglu, Meltem
    2015 MEDICAL TECHNOLOGIES NATIONAL CONFERENCE (TIPTEKNO), 2015,
  • [44] Infants' neural responses to facial emotion in the prefrontal cortex are correlated with temperament: a functional near-infrared spectroscopy study
    Ravicz, Miranda M.
    Perdue, Katherine L.
    Westerlund, Alissa
    Vanderwert, Ross E.
    Nelson, Charles A.
    FRONTIERS IN PSYCHOLOGY, 2015, 6
  • [45] Multi-time-point analysis: A time course analysis with functional near-infrared spectroscopy
    Yu, Chi-Lin
    Chen, Hsin-Chin
    Yang, Zih-Yun
    Chou, Tai-Li
    BEHAVIOR RESEARCH METHODS, 2020, 52 (04) : 1700 - 1713
  • [46] Spatial Coregistration of Functional Near-Infrared Spectroscopy to Brain MRI
    Chen, Michelle
    Blumen, Helena M.
    Izzetoglu, Meltem
    Holtzer, Roee
    JOURNAL OF NEUROIMAGING, 2017, 27 (05) : 453 - 460
  • [47] Functional Near-Infrared Spectroscopy and Electroencephalography: A Multimodal Imaging Approach
    Merzagora, Anita C.
    Izzetoglu, Meltem
    Polikar, Robi
    Weisser, Valerie
    Onaral, Banu
    Schultheis, Maria T.
    FOUNDATIONS OF AUGMENTED COGNITION, PROCEEDINGS: NEUROERGONOMICS AND OPERATIONAL NEUROSCIENCE, 2009, 5638 : 417 - +
  • [48] FUNCTIONAL NEAR-INFRARED SPECTROSCOPY APPLICATIONS IN DEVELOPMENTAL COGNITIVE NEUROSCIENCE
    Sitnikova, M. A.
    Malykh, S. B.
    ZHURNAL VYSSHEI NERVNOI DEYATELNOSTI IMENI I P PAVLOVA, 2021, 71 (04) : 485 - 499
  • [49] Automatic recognition of hemodynamic responses to rare stimuli using functional Near-Infrared Spectroscopy
    Butti, M.
    Merzagora, A. C.
    Izzetoglu, M.
    Bunce, S.
    Bianchi, A. M.
    Cerutti, S.
    Onaral, B.
    11TH MEDITERRANEAN CONFERENCE ON MEDICAL AND BIOLOGICAL ENGINEERING AND COMPUTING 2007, VOLS 1 AND 2, 2007, 16 (1-2): : 473 - +
  • [50] Binary Classification Methods for Movement Analysis from Functional Near-Infrared Spectroscopy Signals
    Sanchez-Reolid, Daniel
    Sanchez-Reolid, Roberto
    Gomez-Sirvent, Jose L.
    Borja, Alejandro L.
    Ferrandez, Jose M.
    Fernandez-Caballero, Antonio
    ARTIFICIAL INTELLIGENCE FOR NEUROSCIENCE AND EMOTIONAL SYSTEMS, PT I, IWINAC 2024, 2024, 14674 : 401 - 410