Emotion Recognition From EEG Signal Focusing on Deep Learning and Shallow Learning Techniques

被引:86
作者
Islam, Md. Rabiul [1 ]
Moni, Mohammad Ali [2 ]
Islam, Md. Milon [3 ]
Rashed-Al-Mahfuz, Md. [4 ]
Islam, Md. Saiful [5 ]
Hasan, Md. Kamrul [6 ]
Hossain, Md. Sabir [7 ]
Ahmad, Mohiuddin [6 ]
Uddin, Shahadat [8 ]
Azad, Akm [9 ]
Alyami, Salem A. [10 ]
Ahad, Md. Atiqur Rahman [11 ]
Lio, Pietro [12 ]
机构
[1] Bangladesh Army Univ Engn & Technol, Dept Elect & Elect Engn, Natore 6431, Bangladesh
[2] Univ New South Wales, WHO Ctr eHlth, UNSW Digital Hlth, Fac Med, Sydney, NSW 2052, Australia
[3] Khulna Univ Engn & Technol, Dept Comp Sci & Engn, Khulna 9203, Bangladesh
[4] Rajshahi Univ, Dept Comp Sci & Engn, Rajshahi 6205, Bangladesh
[5] Griffith Univ, Sch Informat & Commun Technol, Southport, Qld 4222, Australia
[6] Khulna Univ Engn & Technol, Dept Elect & Elect Engn, Khulna 9203, Bangladesh
[7] Chittagong Univ Engn & Technol, Dept Comp Sci & Engn, Chittagong 4349, Bangladesh
[8] Univ Sydney, Complex Syst Res Grp, Fac Engn, Darlington, NSW 2008, Australia
[9] Univ Technol Sydney, iThree Inst, Fac Sci, Ultimo, NSW 2007, Australia
[10] Imam Mohammad Ibn Saud Islamic Univ IMSIU, Dept Math & Stat, Fac Sci, Riyadh 13318, Saudi Arabia
[11] Osaka Univ, Dept Media Intelligent, Ibaraki 5670047, Japan
[12] Univ Cambridge, Comp Lab, Cambridge CB3 0FD, England
关键词
Emotion recognition; Electroencephalography; Brain modeling; Support vector machines; Solid modeling; Human computer interaction; Three-dimensional displays; Emotion; electroencephalogram; human-computer interaction; deep learning; shallow learning; FEATURE-SELECTION; FEATURE-EXTRACTION; FASTICA ALGORITHM; CLASSIFICATION; NETWORK; PERFORMANCE; TRANSFORM; FEATURES; ENTROPY; GESTURE;
D O I
10.1109/ACCESS.2021.3091487
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, electroencephalogram-based emotion recognition has become crucial in enabling the Human-Computer Interaction (HCI) system to become more intelligent. Due to the outstanding applications of emotion recognition, e.g., person-based decision making, mind-machine interfacing, cognitive interaction, affect detection, feeling detection, etc., emotion recognition has become successful in attracting the recent hype of AI-empowered research. Therefore, numerous studies have been conducted driven by a range of approaches, which demand a systematic review of methodologies used for this task with their feature sets and techniques. It will facilitate the beginners as guidance towards composing an effective emotion recognition system. In this article, we have conducted a rigorous review on the state-of-the-art emotion recognition systems, published in recent literature, and summarized some of the common emotion recognition steps with relevant definitions, theories, and analyses to provide key knowledge to develop a proper framework. Moreover, studies included here were dichotomized based on two categories: i) deep learning-based, and ii) shallow machine learning-based emotion recognition systems. The reviewed systems were compared based on methods, classifier, the number of classified emotions, accuracy, and dataset used. An informative comparison, recent research trends, and some recommendations are also provided for future research directions.
引用
收藏
页码:94601 / 94624
页数:24
相关论文
共 50 条
[31]   Deep Learning Techniques for Speech Emotion Recognition : A Review [J].
Pandey, Sandeep Kumar ;
Shekhawat, H. S. ;
Prasanna, S. R. M. .
2019 29TH INTERNATIONAL CONFERENCE RADIOELEKTRONIKA (RADIOELEKTRONIKA), 2019, :197-202
[32]   EEG-based emotion recognition: Review of commercial EEG devices and machine learning techniques [J].
Dadebayev, Didar ;
Goh, Wei Wei ;
Tan, Ee Xion .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (07) :4385-4401
[33]   Frame-Level Teacher-Student Learning With Data Privacy for EEG Emotion Recognition [J].
Gu, Tianhao ;
Wang, Zhe ;
Xu, Xinlei ;
Li, Dongdong ;
Yang, Hai ;
Du, Wenli .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) :11021-11028
[34]   Epileptic Seizure Detection in EEG Signals Using Machine Learning and Deep Learning Techniques [J].
Kode, Hepseeba ;
Elleithy, Khaled ;
Almazaydeh, Laiali .
IEEE ACCESS, 2024, 12 :80657-80668
[35]   Emotion Recognition from Facial Expression using Explainable Deep Learning [J].
Cesarelli, Mario ;
Martinelli, Fabio ;
Mercaldo, Francesco ;
Santone, Antonella .
2022 IEEE INTL CONF ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING, INTL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING, INTL CONF ON CLOUD AND BIG DATA COMPUTING, INTL CONF ON CYBER SCIENCE AND TECHNOLOGY CONGRESS (DASC/PICOM/CBDCOM/CYBERSCITECH), 2022, :306-311
[36]   Modified Earthworm Optimization With Deep Learning Assisted Emotion Recognition for Human Computer Interface [J].
Alrowais, Fadwa ;
Negm, Noha ;
Khalid, Majdi ;
Almalki, Nabil ;
Marzouk, Radwa ;
Mohamed, Abdullah ;
Al Duhayyim, Mesfer ;
Alneil, Amani A. .
IEEE ACCESS, 2023, 11 :35089-35096
[37]   A review on EEG-based multimodal learning for emotion recognition [J].
Pillalamarri, Rajasekhar ;
Shanmugam, Udhayakumar .
ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (05)
[38]   Contrastive Learning of EEG Representation of Brain Area for Emotion Recognition [J].
Dai, Sheng ;
Li, Ming ;
Wu, Xu ;
Ju, Xiangyu ;
Li, Xinyu ;
Yang, Jun ;
Hu, Dewen .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
[39]   Exploring the Effectiveness of Machine Learning and Deep Learning Techniques for EEG Signal Classification in Neurological Disorders [J].
Khalfallah, Souhaila ;
Puech, William ;
Tlija, Mehdi ;
Bouallegue, Kais .
IEEE ACCESS, 2025, 13 :17002-17015
[40]   Human emotion recognition from EEG-based brain-computer interface using machine learning: a comprehensive review [J].
Houssein, Essam H. ;
Hammad, Asmaa ;
Ali, Abdelmgeid A. .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (15) :12527-12557