Affective EEG-Based Person Identification Using the Deep Learning Approach

被引:122
作者
Wilaiprasitporn, Theerawit [1 ]
Ditthapron, Apiwat [2 ]
Matchaparn, Karis [3 ]
Tongbuasirilai, Tanaboon [4 ]
Banluesombatkul, Nannapas [1 ]
Chuangsuwanich, Ekapol [5 ]
机构
[1] Vidyasirimedhi Inst Sci & Engn, Sch Informat Sci & Technol, Bioinspired Robot & Neural Engn Lab, Rayong 21210, Thailand
[2] Worcester Polytech Inst, Dept Comp, Worcester, MA 01609 USA
[3] King Mongkuts Univ Technol Thonburi, Dept Comp Engn, Bangkok 10140, Thailand
[4] Linkoping Univ, Dept Sci & Technol, S-58183 Linkoping, Sweden
[5] Chulalongkorn Univ, Dept Comp Engn, Bangkok 10330, Thailand
关键词
Electroencephalography; Logic gates; Task analysis; Deep learning; Feature extraction; Brain modeling; Biometrics (access control); Affective computing; biometrics; convolutional neural networks (CNNs); deep learning (DL); electroencephalography (EEG); long short-term memory (LSTM); personal identification (PI); recurrent neural networks (RNNs); NEURAL-NETWORKS; SIGNALS; RECOGNITION; BIOMETRICS;
D O I
10.1109/TCDS.2019.2924648
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalography (EEG) is another method for performing person identification (PI). Due to the nature of the EEG signals, EEG-based PI is typically done while a person is performing a mental task such as motor control. However, few studies used EEG-based PI while the person is in different mental states (affective EEG). The aim of this paper is to improve the performance of affective EEG-based PI using a deep learning (DL) approach. We proposed a cascade of DL using a combination of convolutional neural networks (CNNs) and recurrent neural networks (RNNs). CNNs are used to handle the spatial information from the EEG while RNNs extract the temporal information. We evaluated two types of RNNs, namely long short-term memory (LSTM) and gated recurrent unit (GRU). The proposed method is evaluated on the state-of-the-art affective data set DEAP. The results indicate that CNN-GRU and CNN-LSTM can perform PI from different affective states and reach up to 99.90%-100% mean correct recognition rate. This significantly outperformed a support vector machine baseline system that used power spectral density features. Notably, the 100% mean CRR came from 32 subjects in DEAP data set. Even after the reduction of the number of EEG electrodes from 32 to 5 for more practical applications, the model could still maintain an optimal result obtained from the frontal region, reaching up to 99.17%. Amongst the two DL models, we found that CNN-GRU and CNN-LSTM performed similarly while CNN-GRU expended faster training time. In conclusion, the studied DL approaches overcame the influence of affective states in EEG-Based PI reported in the previous works.
引用
收藏
页码:486 / 496
页数:11
相关论文
共 55 条
  • [21] Knerr S., 1990, Neurocomputing, Algorithms, Architectures and Applications. Proceedings of the NATO Advanced Research Workshop, P41
  • [22] DEAP: A Database for Emotion Analysis Using Physiological Signals
    Koelstra, Sander
    Muhl, Christian
    Soleymani, Mohammad
    Lee, Jong-Seok
    Yazdani, Ashkan
    Ebrahimi, Touradj
    Pun, Thierry
    Nijholt, Anton
    Patras, Ioannis
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2012, 3 (01) : 18 - 31
  • [23] Kumari P, 2014, 2014 INTERNATIONAL CONFERENCE ON SIGNAL PROPAGATION AND COMPUTER TECHNOLOGY (ICSPCT 2014), P283, DOI 10.1109/ICSPCT.2014.6885030
  • [24] Human Brain Distinctiveness Based on EEG Spectral Coherence Connectivity
    La Rocca, D.
    Campisi, P.
    Vegso, B.
    Cserti, P.
    Kozmann, G.
    Babiloni, F.
    Fallani, F. De Vico
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2014, 61 (09) : 2406 - 2412
  • [25] Lee HJ, 2013, I IEEE EMBS C NEUR E, P13, DOI 10.1109/NER.2013.6695859
  • [26] Li Y., 2017, LNCS, V19568
  • [27] A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines
    Lu, Na
    Li, Tengfei
    Ren, Xiaodong
    Miao, Hongyu
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (06) : 566 - 576
  • [28] Ma L, 2015, IEEE ENG MED BIO, P2848, DOI 10.1109/EMBC.2015.7318985
  • [29] EEG signal preprocessing for biometric recognition
    Maiorana, Emanuele
    Sole-Casals, Jordi
    Campisi, Patrizio
    [J]. MACHINE VISION AND APPLICATIONS, 2016, 27 (08) : 1351 - 1360
  • [30] On the Permanence of EEG Signals for Biometric Recognition
    Maiorana, Emanuele
    La Rocca, Daria
    Campisi, Patrizio
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2016, 11 (01) : 163 - 175