MLDA: Multi-Loss Domain Adaptor for Cross-Session and Cross-Emotion EEG-Based Individual Identification

被引:5
作者
Miao, Yifan [1 ,2 ,3 ]
Jiang, Wanqing [1 ,2 ,3 ]
Su, Nuo [4 ]
Shan, Jun [4 ]
Jiang, Tianzi [1 ,2 ,3 ]
Zuo, Nianming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Brainnetome Ctr, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Inst Automat, NLPR, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Ocean Univ China, Coll Comp Sci & Technol, Qingdao 266100, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Task analysis; Support vector machines; Recording; Motion pictures; Brain modeling; EEG; biometric; across mental states; across time; deep learning; domain adaptation; BRAIN;
D O I
10.1109/JBHI.2023.3315974
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional individual identification methods, such as face and fingerprint recognition, carry the risk of personal information leakage. The uniqueness and privacy of electroencephalograms (EEG) and the popularization of EEG acquisition devices have intensified research on EEG-based individual identification in recent years. However, most existing work uses EEG signals from a single session or emotion, ignoring large differences between domains. As EEG signals do not satisfy the traditional deep learning assumption that training and test sets are independently and identically distributed, it is difficult for trained models to maintain good classification performance for new sessions or new emotions. In this article, an individual identification method, called Multi-Loss Domain Adaptor (MLDA), is proposed to deal with the differences between marginal and conditional distributions elicited by different domains. The proposed method consists of four parts: a) Feature extractor, which uses deep neural networks to extract deep features from EEG data; b) Label predictor, which uses full-layer networks to predict subject labels; c) Marginal distribution adaptation, which uses maximum mean discrepancy (MMD) to reduce marginal distribution differences; d) Associative domain adaptation, which adapts to conditional distribution differences. Using the MLDA method, the cross-session and cross-emotion EEG-based individual identification problem is addressed by reducing the influence of time and emotion. Experimental results confirmed that the method outperforms other state-of-the-art approaches.
引用
收藏
页码:5767 / 5778
页数:12
相关论文
共 48 条
  • [1] Simultaneous head tissue conductivity and EEG source location estimation
    Acar, Zeynep Akalin
    Acar, Can E.
    Makeig, Scott
    [J]. NEUROIMAGE, 2016, 124 : 168 - 180
  • [2] On the Influence of Affect in EEG-Based Subject Identification
    Arnau-Gonzalez, Pablo
    Arevalillo-Herraez, Miguel
    Katsigiannis, Stamos
    Ramzan, Naeem
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (02) : 391 - 401
  • [3] Graph theoretical brain connectivity measures to investigate neural correlates of music rhythms associated with fear and anger
    Aydin, Serap
    Onbasi, Lara
    [J]. COGNITIVE NEURODYNAMICS, 2024, 18 (01) : 49 - 66
  • [4] A survey on methods and challenges in EEG based authentication
    Bidgoly, Amir Jalaly
    Bidgoly, Hamed Jalaly
    Arezoumand, Zeynab
    [J]. COMPUTERS & SECURITY, 2020, 93
  • [5] BRIGHAM K, 2010, BIOINF BIOM ENG ICBB, P1, DOI [10.1109/icbbe.2010.5515807, DOI 10.1109/ICBBE.2010.5515807]
  • [6] Analysis of factors that influence the performance of biometric systems based on EEG signals
    Carrion-Ojeda, Dustin
    Fonseca-Delgado, Rigoberto
    Pineda, Israel
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 165
  • [7] Courty N., 2017, Proc. Neural Inf. Process. Syst, P3733
  • [8] Using Rapid Visually Evoked EEG Activity for Person Identification
    Das, Koel
    Zhang, Sheng
    Giesbrecht, Barry
    Eckstein, Miguel P.
    [J]. 2009 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-20, 2009, : 2490 - 2493
  • [9] Action potentials of the brain - In normal persons and in normal states of cerebral activity
    Davis, H
    Davis, PA
    [J]. ARCHIVES OF NEUROLOGY AND PSYCHIATRY, 1936, 36 (06): : 1214 - 1224
  • [10] Increased global integration in the brain after psilocybin therapy for depression
    Daws, Richard E.
    Timmermann, Christopher
    Giribaldi, Bruna
    Sexton, James D.
    Wall, Matthew B.
    Erritzoe, David
    Roseman, Leor
    Nutt, David
    Carhart-Harris, Robin
    [J]. NATURE MEDICINE, 2022, 28 (04) : 844 - 851