Affective EEG-Based Person Identification Using the Deep Learning Approach

被引:122
作者
Wilaiprasitporn, Theerawit [1 ]
Ditthapron, Apiwat [2 ]
Matchaparn, Karis [3 ]
Tongbuasirilai, Tanaboon [4 ]
Banluesombatkul, Nannapas [1 ]
Chuangsuwanich, Ekapol [5 ]
机构
[1] Vidyasirimedhi Inst Sci & Engn, Sch Informat Sci & Technol, Bioinspired Robot & Neural Engn Lab, Rayong 21210, Thailand
[2] Worcester Polytech Inst, Dept Comp, Worcester, MA 01609 USA
[3] King Mongkuts Univ Technol Thonburi, Dept Comp Engn, Bangkok 10140, Thailand
[4] Linkoping Univ, Dept Sci & Technol, S-58183 Linkoping, Sweden
[5] Chulalongkorn Univ, Dept Comp Engn, Bangkok 10330, Thailand
关键词
Electroencephalography; Logic gates; Task analysis; Deep learning; Feature extraction; Brain modeling; Biometrics (access control); Affective computing; biometrics; convolutional neural networks (CNNs); deep learning (DL); electroencephalography (EEG); long short-term memory (LSTM); personal identification (PI); recurrent neural networks (RNNs); NEURAL-NETWORKS; SIGNALS; RECOGNITION; BIOMETRICS;
D O I
10.1109/TCDS.2019.2924648
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalography (EEG) is another method for performing person identification (PI). Due to the nature of the EEG signals, EEG-based PI is typically done while a person is performing a mental task such as motor control. However, few studies used EEG-based PI while the person is in different mental states (affective EEG). The aim of this paper is to improve the performance of affective EEG-based PI using a deep learning (DL) approach. We proposed a cascade of DL using a combination of convolutional neural networks (CNNs) and recurrent neural networks (RNNs). CNNs are used to handle the spatial information from the EEG while RNNs extract the temporal information. We evaluated two types of RNNs, namely long short-term memory (LSTM) and gated recurrent unit (GRU). The proposed method is evaluated on the state-of-the-art affective data set DEAP. The results indicate that CNN-GRU and CNN-LSTM can perform PI from different affective states and reach up to 99.90%-100% mean correct recognition rate. This significantly outperformed a support vector machine baseline system that used power spectral density features. Notably, the 100% mean CRR came from 32 subjects in DEAP data set. Even after the reduction of the number of EEG electrodes from 32 to 5 for more practical applications, the model could still maintain an optimal result obtained from the frontal region, reaching up to 99.17%. Amongst the two DL models, we found that CNN-GRU and CNN-LSTM performed similarly while CNN-GRU expended faster training time. In conclusion, the studied DL approaches overcame the influence of affective states in EEG-Based PI reported in the previous works.
引用
收藏
页码:486 / 496
页数:11
相关论文
共 55 条
  • [1] [Anonymous], 2017, arXiv
  • [2] [Anonymous], 2009, INT J BIOMEDICAL SOF
  • [3] Arnau-Gonzalez P., IEEE T AFFECTIVE COM
  • [4] Ashby C, 2011, I IEEE EMBS C NEUR E, P442, DOI 10.1109/NER.2011.5910581
  • [5] Campisi P., 2011, 2011 IEEE International Workshop on Information Forensics and Security (WIFS 2011), DOI 10.1109/WIFS.2011.6123138
  • [6] Brain Waves for Automatic Biometric-Based User Recognition
    Campisi, Patrizio
    La Rocca, Daria
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2014, 9 (05) : 782 - 800
  • [7] Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks
    Chen, J. X.
    Zhang, P. W.
    Mao, Z. J.
    Huang, Y. F.
    Jiang, D. M.
    Zhang, Andy N.
    [J]. IEEE ACCESS, 2019, 7 : 44317 - 44328
  • [8] A High-Security EEG-Based Login System with RSVP Stimuli and Dry Electrodes
    Chen, Yiyu
    Atnafu, Ayalneh Dessalegn
    Schlattner, Isabella
    Weldtsadik, Wendimagegn Tariku
    Roh, Myung-Cheol
    Kim, Hyoung Joong
    Lee, Seong-Whan
    Blankertz, Benjamin
    Fazli, Siamac
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2016, 11 (12) : 2635 - 2647
  • [9] Cho Kyunghyun, 2014, Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation, DOI [10.3115/v1/w14-4012, DOI 10.3115/V1/W14-4012]
  • [10] Chung J., 2014, ARXIV14123555, DOI DOI 10.48550/ARXIV.1412.3555