Emotion recognition in EEG signals using deep learning methods: A review

被引:81
作者
Jafari, Mahboobeh [1 ]
Shoeibi, Afshin [1 ]
Khodatars, Marjane [1 ]
Bagherzadeh, Sara [2 ]
Shalbaf, Ahmad [3 ]
Garcia, David Lopez [1 ]
Gorriz, Juan M. [1 ,4 ]
Acharya, U. Rajendra [5 ]
机构
[1] Univ Granada, Data Sci & Computat Intelligence Inst, Granada, Spain
[2] Islamic Azad Univ, Dept Biomed Engn, Sci & Res Branch, Tehran, Iran
[3] Shahid Beheshti Univ Med Sci, Sch Med, Dept Biomed Engn & Med Phys, Tehran, Iran
[4] Univ Cambridge, Dept Psychiat, Cambridge, England
[5] Univ Southern Queensland, Sch Math Phys & Comp, Springfield, Australia
关键词
Emotion recognition; Biological signals; EEG; Artificial intelligence; Deep learning; CONVOLUTIONAL NEURAL-NETWORKS; MULTICHANNEL EEG; DATA AUGMENTATION; GRAPH; FEATURES; CLASSIFICATION; EXPRESSION; CNN; SCHIZOPHRENIA; AUTOENCODER;
D O I
10.1016/j.compbiomed.2023.107450
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Emotions are a critical aspect of daily life and serve a crucial role in human decision-making, planning, reasoning, and other mental states. As a result, they are considered a significant factor in human interactions. Human emotions can be identified through various sources, such as facial expressions, speech, behavior (gesture/ position), or physiological signals. The use of physiological signals can enhance the objectivity and reliability of emotion detection. Compared with peripheral physiological signals, electroencephalogram (EEG) recordings are directly generated by the central nervous system and are closely related to human emotions. EEG signals have the great spatial resolution that facilitates the evaluation of brain functions, making them a popular modality in emotion recognition studies. Emotion recognition using EEG signals presents several challenges, including signal variability due to electrode positioning, individual differences in signal morphology, and lack of a universal standard for EEG signal processing. Moreover, identifying the appropriate features for emotion recognition from EEG data requires further research. Finally, there is a need to develop more robust artificial intelligence (AI) including conventional machine learning (ML) and deep learning (DL) methods to handle the complex and diverse EEG signals associated with emotional states. This paper examines the application of DL techniques in emotion recognition from EEG signals and provides a detailed discussion of relevant articles. The paper explores the significant challenges in emotion recognition using EEG signals, highlights the potential of DL techniques in addressing these challenges, and suggests the scope for future research in emotion recognition using DL techniques. The paper concludes with a summary of its findings.
引用
收藏
页数:31
相关论文
共 357 条
[1]  
Abdullah S.M.S.A., 2021, Journal of Applied Science and Technology Trends, V2, P52, DOI DOI 10.38094/JASTT20291
[2]   A comprehensive review of facial expression recognition techniques [J].
Adyapady, R. Rashmi ;
Annappa, B. .
MULTIMEDIA SYSTEMS, 2023, 29 (01) :73-103
[3]   EEG-Based Emotion Recognition Using Deep Learning and M3GP [J].
Aguinaga, Adrian Rodriguez ;
Delgado, Luis Munoz ;
Lopez-Lopez, Victor Raul ;
Tellez, Andres Calvillo .
APPLIED SCIENCES-BASEL, 2022, 12 (05)
[4]   Emotion recognition with deep learning using GAMEEMO data set [J].
Alakus, T. B. ;
Turkoglu, I. .
ELECTRONICS LETTERS, 2020, 56 (25) :1364-1367
[5]   Deep Learning-Based Approach for Emotion Recognition Using Electroencephalography (EEG) Signals Using Bi-Directional Long Short-Term Memory (Bi-LSTM) [J].
Algarni, Mona ;
Saeed, Faisal ;
Al-Hadhrami, Tawfik ;
Ghabban, Fahad ;
Al-Sarem, Mohammed .
SENSORS, 2022, 22 (08)
[6]   Emotion Recognition Involving Physiological and Speech Signals: A Comprehensive Review [J].
Ali, Mouhannad ;
Mosa, Ahmad Haj ;
Al Machot, Fadi ;
Kyamakya, Kyandoghere .
RECENT ADVANCES IN NONLINEAR DYNAMICS AND SYNCHRONIZATION: WITH SELECTED APPLICATIONS IN ELECTRICAL ENGINEERING, NEUROCOMPUTING, AND TRANSPORTATION, 2018, 109 :287-302
[7]   Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustworthy Artificial Intelligence [J].
Ali, Sajid ;
Abuhmed, Tamer ;
El-Sappagh, Shaker ;
Muhammad, Khan ;
Alonso-Moral, Jose M. ;
Confalonieri, Roberto ;
Guidotti, Riccardo ;
Del Ser, Javier ;
Diaz-Rodriguez, Natalia ;
Herrera, Francisco .
INFORMATION FUSION, 2023, 99
[8]   Uncertainty-Aware Semi-Supervised Method Using Large Unlabeled and Limited Labeled COVID-19 Data [J].
Alizadehsani, Roohallah ;
Sharifrazi, Danial ;
Izadi, Navid Hoseini ;
Joloudari, Javad Hassannataj ;
Shoeibi, Afshin ;
Gorriz, Juan M. ;
Hussain, Sadiq ;
Arco, Juan E. ;
Sani, Zahra Alizadeh ;
Khozeimeh, Fahime ;
Khosravi, Abbas ;
Nahavandi, Saeid ;
Islam, Sheikh Mohammed Shariful ;
Acharya, U. Rajendra .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2021, 17 (03)
[9]   An AI-Inspired Spatio-Temporal Neural Network for EEG-Based Emotional Status [J].
Alotaibi, Fahad Mazaed ;
Fawad .
SENSORS, 2023, 23 (01)