Emotion recognition in EEG signals using deep learning methods: A review

被引:86
作者
Jafari, Mahboobeh [1 ]
Shoeibi, Afshin [1 ]
Khodatars, Marjane [1 ]
Bagherzadeh, Sara [2 ]
Shalbaf, Ahmad [3 ]
Garcia, David Lopez [1 ]
Gorriz, Juan M. [1 ,4 ]
Acharya, U. Rajendra [5 ]
机构
[1] Univ Granada, Data Sci & Computat Intelligence Inst, Granada, Spain
[2] Islamic Azad Univ, Dept Biomed Engn, Sci & Res Branch, Tehran, Iran
[3] Shahid Beheshti Univ Med Sci, Sch Med, Dept Biomed Engn & Med Phys, Tehran, Iran
[4] Univ Cambridge, Dept Psychiat, Cambridge, England
[5] Univ Southern Queensland, Sch Math Phys & Comp, Springfield, Australia
关键词
Emotion recognition; Biological signals; EEG; Artificial intelligence; Deep learning; CONVOLUTIONAL NEURAL-NETWORKS; MULTICHANNEL EEG; DATA AUGMENTATION; GRAPH; FEATURES; CLASSIFICATION; EXPRESSION; CNN; SCHIZOPHRENIA; AUTOENCODER;
D O I
10.1016/j.compbiomed.2023.107450
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Emotions are a critical aspect of daily life and serve a crucial role in human decision-making, planning, reasoning, and other mental states. As a result, they are considered a significant factor in human interactions. Human emotions can be identified through various sources, such as facial expressions, speech, behavior (gesture/ position), or physiological signals. The use of physiological signals can enhance the objectivity and reliability of emotion detection. Compared with peripheral physiological signals, electroencephalogram (EEG) recordings are directly generated by the central nervous system and are closely related to human emotions. EEG signals have the great spatial resolution that facilitates the evaluation of brain functions, making them a popular modality in emotion recognition studies. Emotion recognition using EEG signals presents several challenges, including signal variability due to electrode positioning, individual differences in signal morphology, and lack of a universal standard for EEG signal processing. Moreover, identifying the appropriate features for emotion recognition from EEG data requires further research. Finally, there is a need to develop more robust artificial intelligence (AI) including conventional machine learning (ML) and deep learning (DL) methods to handle the complex and diverse EEG signals associated with emotional states. This paper examines the application of DL techniques in emotion recognition from EEG signals and provides a detailed discussion of relevant articles. The paper explores the significant challenges in emotion recognition using EEG signals, highlights the potential of DL techniques in addressing these challenges, and suggests the scope for future research in emotion recognition using DL techniques. The paper concludes with a summary of its findings.
引用
收藏
页数:31
相关论文
共 357 条
[31]  
Bharati S, 2023, IEEE Transactions on Artificial Intelligence
[32]   Calibration free meta learning based approach for subject independent EEG emotion recognition [J].
Bhosale, Swapnil ;
Chakraborty, Rupayan ;
Kopparapu, Sunil Kumar .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 72
[33]   A Review, Current Challenges, and Future Possibilities on Emotion Recognition Using Machine Learning and Physiological Signals [J].
Bota, Patricia J. ;
Wang, Chen ;
Fred, Ana L. N. ;
da Silva, Hugo Placido .
IEEE ACCESS, 2019, 7 :140990-141020
[34]   Two-Stream Attention 3-D Deep Network-Based Childhood Epilepsy Syndrome Classification [J].
Cao, Jiuwen ;
Feng, Yuanmeng ;
Zheng, Runze ;
Cui, Xiaonan ;
Zhao, Weijie ;
Jiang, Tiejia ;
Gao, Feng .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[35]   Performance Analysis of Google Colaboratory as a Tool for Accelerating Deep Learning Applications [J].
Carneiro, Tiago ;
Medeiros Da Nobrega, Raul Victor ;
Nepomuceno, Thiago ;
Bian, Gui-Bin ;
De Albuquerque, Victor Hugo C. ;
Reboucas Filho, Pedro Pedrosa .
IEEE ACCESS, 2018, 6 :61677-61685
[36]   Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals [J].
Chao, Hao ;
Dong, Liang .
IEEE SENSORS JOURNAL, 2021, 21 (02) :2024-2034
[37]   Emotion Recognition from Multiband EEG Signals Using CapsNet [J].
Chao, Hao ;
Dong, Liang ;
Liu, Yongli ;
Lu, Baoyun .
SENSORS, 2019, 19 (09)
[38]   Recognition of Emotions Using Multichannel EEG Data and DBN-GC-Based Ensemble Deep Learning Framework [J].
Chao, Hao ;
Zhi, Huilai ;
Dong, Liang ;
Liu, Yongli .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2018, 2018
[39]   Music mood and human emotion recognition based on physiological signals: a systematic review [J].
Chaturvedi, Vybhav ;
Kaur, Arman Beer ;
Varshney, Vedansh ;
Garg, Anupam ;
Chhabra, Gurpal Singh ;
Kumar, Munish .
MULTIMEDIA SYSTEMS, 2022, 28 (01) :21-44
[40]  
Chawla NV, 2010, DATA MINING AND KNOWLEDGE DISCOVERY HANDBOOK, SECOND EDITION, P875, DOI 10.1007/978-0-387-09823-4_45