NEMO: A Database for Emotion Analysis Using Functional Near-Infrared Spectroscopy

被引:0
|
作者
Spape, Michiel [1 ,2 ]
Makela, Kalle [1 ]
Ruotsalo, Tuukka [3 ,4 ]
机构
[1] Univ Helsinki, Helsinki 00100, Finland
[2] Univ Macau, ICI CCBS, Macau 999078, Peoples R China
[3] Univ Copenhagen, DK-1172 Copenhagen, Denmark
[4] LUT Univ, Lappeenranta 53850, Finland
基金
欧盟地平线“2020”; 芬兰科学院;
关键词
Affective computing; emotion classification; FNIRS; functional near-infrared spectroscopy; pattern classification; signal processing; FRONTAL EEG ASYMMETRY; ACTIVATION; HISTORY; CORTEX; FNIRS;
D O I
10.1109/TAFFC.2023.3315971
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a dataset for the analysis of human affective states using functional near-infrared spectroscopy (fNIRS). Data were recorded from thirty-one participants who engaged in two tasks. In the emotional perception task the participants passively viewed images sampled from the standard international affective picture system database, which provided ground-truth valence and arousal annotation for the stimuli. In the affective imagery task the participants actively imagined emotional scenarios followed by rating these for subjective valence and arousal. Correlates between the fNIRS signal and the valence-arousal ratings were investigated to estimate the validity of the dataset. Source-code and summaries are provided for a processing pipeline, brain activity group analysis, and estimating baseline classification performance. For classification, prediction experiments are conducted for single-trial 4-class classification of arousal and valence as well as cross-participant classifications, and comparisons between high and low arousal variants of the valence prediction tasks. Finally, classification results are presented for subject-specific and cross-participant models. The dataset is made publicly available to encourage research on affective decoding and downstream applications using fNIRS data.
引用
收藏
页码:1166 / 1177
页数:12
相关论文
共 50 条
  • [1] Building predictive models of emotion with functional near-infrared spectroscopy
    Bandara, Danushka
    Velipasalar, Senem
    Bratt, Sarah
    Hirshfield, Leanne
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2018, 110 : 75 - 85
  • [2] Similarity analysis of functional connectivity with functional near-infrared spectroscopy
    Dalmis, Mehmet Ufuk
    Akin, Ata
    JOURNAL OF BIOMEDICAL OPTICS, 2015, 20 (08)
  • [3] On fractality of functional near-infrared spectroscopy signals: analysis and applications
    Zhu, Li
    Haghani, Sasan
    Najafizadeh, Laleh
    NEUROPHOTONICS, 2020, 7 (02)
  • [4] Functional near-infrared spectroscopy for intraoperative brain mapping
    Qiu, Tianming
    Hameed, N. U. Farrukh
    Peng, Yuerong
    Wang, Shuheng
    Wu, Jinsong
    Zhou, Liangfu
    NEUROPHOTONICS, 2019, 6 (04)
  • [5] Depression Analysis and Recognition Based on Functional Near-Infrared Spectroscopy
    Wang, Rui
    Hao, Yixue
    Yu, Qiao
    Chen, Min
    Humar, Iztok
    Fortino, Giancarlo
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (12) : 4289 - 4299
  • [6] Measuring visual cortical oxygenation in diabetes using functional near-infrared spectroscopy
    Aitchison, Ross T.
    Ward, Laura
    Kennedy, Graeme J.
    Shu, Xinhua
    Mansfield, David C.
    Shahani, Uma
    ACTA DIABETOLOGICA, 2018, 55 (11) : 1181 - 1189
  • [7] Assessing functional impulsivity using functional near-infrared spectroscopy
    Nakazawa, Kenta
    Hirabayashi, Kazue
    Kawai, Wakana
    Kyutoku, Yasushi
    Duncan, Keith Kawabata
    Dan, Ippeita
    FRONTIERS IN NEUROERGONOMICS, 2023, 4
  • [8] Functional near-infrared spectroscopy in non-invasive neuromodulation
    Huo, Congcong
    Xu, Gongcheng
    Xie, Hui
    Chen, Tiandi
    Shao, Guangjian
    Wang, Jue
    Li, Wenhao
    Wang, Daifa
    Li, Zengyong
    NEURAL REGENERATION RESEARCH, 2024, 19 (07) : 1517 - 1522
  • [9] Cortical correlates of speech intelligibility measured using functional near-infrared spectroscopy (fNIRS)
    Lawrence, Rachael J.
    Wiggins, Ian M.
    Anderson, Carly A.
    Davies-Thompson, Jodie
    Hartley, Douglas E. H.
    HEARING RESEARCH, 2018, 370 : 53 - 64
  • [10] Drone Control Using Functional Near-Infrared Spectroscopy
    Zafar, Amad
    Ghafoor, Usman
    Khan, M. Jawad
    Hong, Keum-Shik
    2018 15TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2018, : 384 - 387