Emotion Recognition Based on EEG Using Generative Adversarial Nets and Convolutional Neural Network

被引:28
作者
Pan, Bo [1 ]
Zheng, Wei [1 ]
机构
[1] Jiangsu Univ Sci & Technol, Sch Elect & Informat, Zhenjiang 212100, Jiangsu, Peoples R China
关键词
Adversarial networks - Automatic emotion recognition - Computational model - Data augmentation - Data collection - Emotion recognition - Human computer interaction (HCI) - Sample generations;
D O I
10.1155/2021/2520394
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Emotion recognition plays an important role in the field of human-computer interaction (HCI). Automatic emotion recognition based on EEG is an important topic in brain-computer interface (BCI) applications. Currently, deep learning has been widely used in the field of EEG emotion recognition and has achieved remarkable results. However, due to the cost of data collection, most EEG datasets have only a small amount of EEG data, and the sample categories are unbalanced in these datasets. These problems will make it difficult for the deep learning model to predict the emotional state. In this paper, we propose a new sample generation method using generative adversarial networks to solve the problem of EEG sample shortage and sample category imbalance. In experiments, we explore the performance of emotion recognition with the frequency band correlation and frequency band separation computational models before and after data augmentation on standard EEG-based emotion datasets. Our experimental results show that the method of generative adversarial networks for data augmentation can effectively improve the performance of emotion recognition based on the deep learning model. And we find that the frequency band correlation deep learning model is more conducive to emotion recognition.
引用
收藏
页数:11
相关论文
共 44 条
[1]   A real-time automated system for the recognition of human facial expressions [J].
Anderson, K ;
McOwan, PW .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2006, 36 (01) :96-105
[2]  
[Anonymous], 1999, P P ART NEUR NETW EN
[3]  
[Anonymous], 2016, SIGNAL PROCESSING NE
[4]   Short-term emotion assessment in a recall paradigm [J].
Chanel, Guillaume ;
Kierkels, Joep J. M. ;
Soleymani, Mohammad ;
Pun, Thierry .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2009, 67 (08) :607-627
[5]  
Chen J, 2015, IEEE INT C BIOINFORM, P395, DOI 10.1109/BIBM.2015.7359713
[6]   Dry and Noncontact EEG Sensors for Mobile Brain-Computer Interfaces [J].
Chi, Yu Mike ;
Wang, Yu-Te ;
Wang, Yijun ;
Maier, Christoph ;
Jung, Tzyy-Ping ;
Cauwenberghs, Gert .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2012, 20 (02) :228-235
[7]   Spatio-Temporal Representation of an Electoencephalogram for Emotion Recognition Using a Three-Dimensional Convolutional Neural Network [J].
Cho, Jungchan ;
Hwang, Hyoseok .
SENSORS, 2020, 20 (12) :1-18
[8]   Where Does EEG Come From and What Does It Mean? [J].
Cohen, Michael X. .
TRENDS IN NEUROSCIENCES, 2017, 40 (04) :208-218
[9]   Generative Adversarial Networks An overview [J].
Creswell, Antonia ;
White, Tom ;
Dumoulin, Vincent ;
Arulkumaran, Kai ;
Sengupta, Biswa ;
Bharath, Anil A. .
IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) :53-65
[10]   Speech Emotion Recognition UsingConvolutional Neural Network and Long-Short TermMemory [J].
Dangol, Ranjana ;
Alsadoon, Abeer ;
Prasad, P. W. C. ;
Seher, Indra ;
Alsadoon, Omar Hisham .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (43-44) :32917-32934