Self supervised learning based emotion recognition using physiological signals

被引:2
作者
Zhang, Min [1 ]
Cui, Yanli [1 ]
机构
[1] Huanggang Normal Univ, Comp Coll, Huanggang, Hubei, Peoples R China
来源
FRONTIERS IN HUMAN NEUROSCIENCE | 2024年 / 18卷
关键词
emotional recognition; self-supervised learning; physiological signals; representation learning; deep learning; CONVOLUTIONAL NEURAL-NETWORKS; FEATURE-SELECTION; EEG; FEATURES;
D O I
10.3389/fnhum.2024.1334721
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Introduction The significant role of emotional recognition in the field of human-machine interaction has garnered the attention of many researchers. Emotion recognition based on physiological signals can objectively reflect the most authentic emotional states of humans. However, existing labeled Electroencephalogram (EEG) datasets are often of small scale.Methods In practical scenarios, a large number of unlabeled EEG signals are easier to obtain. Therefore, this paper adopts self-supervised learning methods to study emotion recognition based on EEG. Specifically, experiments employ three pre-defined tasks to define pseudo-labels and extract features from the inherent structure of the data.Results and discussion Experimental results indicate that self-supervised learning methods have the capability to learn effective feature representations for downstream tasks without any manual labels.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Applying Self-Supervised Representation Learning for Emotion Recognition Using Physiological Signals
    Quispe, Kevin G. Montero G.
    Utyiama, Daniel M. S.
    dos Santos, Eulanda M. M.
    Oliveira, Horacio A. B. F.
    Souto, Eduardo J. P.
    SENSORS, 2022, 22 (23)
  • [2] A Review of Emotion Recognition Using Physiological Signals
    Shu, Lin
    Xie, Jinyan
    Yang, Mingyue
    Li, Ziyi
    Li, Zhenqi
    Liao, Dan
    Xu, Xiangmin
    Yang, Xinyi
    SENSORS, 2018, 18 (07)
  • [3] Weakly-Supervised Learning for Fine-Grained Emotion Recognition Using Physiological Signals
    Zhang, Tianyi
    El Ali, Abdallah
    Wang, Chen
    Hanjalic, Alan
    Cesar, Pablo
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2304 - 2322
  • [4] Deep Representation Learning for Multimodal Emotion Recognition Using Physiological Signals
    Zubair, Muhammad
    Woo, Sungpil
    Lim, Sunhwan
    Yoon, Changwoo
    IEEE ACCESS, 2024, 12 : 106605 - 106617
  • [5] Multiple Instance Learning for Emotion Recognition Using Physiological Signals
    Romeo, Luca
    Cavallo, Andrea
    Pepa, Lucia
    Bianchi-Berthouze, Nadia
    Pontil, Massimiliano
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (01) : 389 - 407
  • [6] Emotion Recognition Based on Physiological Signals Using Convolution Neural Networks
    Song, Tongshuai
    Lu, Guanming
    Yan, Jingjie
    ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2018, : 161 - 165
  • [7] Emotion recognition in EEG signals using deep learning methods: A review
    Jafari, Mahboobeh
    Shoeibi, Afshin
    Khodatars, Marjane
    Bagherzadeh, Sara
    Shalbaf, Ahmad
    Garcia, David Lopez
    Gorriz, Juan M.
    Acharya, U. Rajendra
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 165
  • [8] Using Physiological Signals for Emotion Recognition
    Szwoch, Wioleta
    2013 6TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2013, : 556 - 561
  • [9] Emotion Recognition Using Physiological Signals
    Szwoch, Wioleta
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MULTIMEDIA, INTERACTION, DESIGN AND INNOVATION, 2015,
  • [10] Self-supervised representation learning using multimodal Transformer for emotion recognition
    Goetz, Theresa
    Arora, Pulkit
    Erick, F. X.
    Holzer, Nina
    Sawant, Shrutika
    PROCEEDINGS OF THE 8TH INTERNATIONAL WORKSHOP ON SENSOR-BASED ACTIVITY RECOGNITION AND ARTIFICIAL INTELLIGENCE, IWOAR 2023, 2023,