Emotion recognition and artificial intelligence: A systematic review (2014-2023) and research recommendations

被引:78
作者
Khare, Smith K. [1 ]
Blanes-Vidal, Victoria [1 ]
Nadimi, Esmaeil S. [1 ]
Acharya, U. Rajendra [2 ]
机构
[1] Univ Southern Denmark, Maersk Mc Kinney Moller Inst, Fac Engn, Appl & Data Sci Unit, Odense, Denmark
[2] Univ Southern Queensland, Sch Math Phys & Comp, Springfield, Qld, Australia
关键词
Emotion recognition; Speech; Facial images; Electroencephalogram; Electrocardiogram; Eye tracking; Galvanic skin response; Artificial intelligence; Machine learning; Deep learning; FEATURE-EXTRACTION; NEURAL-NETWORK; LEARNING TECHNIQUES; MODE DECOMPOSITION; SPEECH; EEG; CHILDREN; ATTENTION; SIGNALS; ELECTROCARDIOGRAM;
D O I
10.1016/j.inffus.2023.102019
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Emotion recognition is the ability to precisely infer human emotions from numerous sources and modalities using questionnaires, physical signals, and physiological signals. Recently, emotion recognition has gained attention because of its diverse application areas, like affective computing, healthcare, human-robot interactions, and market research. This paper provides a comprehensive and systematic review of emotion recognition techniques of the current decade. The paper includes emotion recognition using physical and physiological signals. Physical signals involve speech and facial expression, while physiological signals include electroencephalogram, electrocardiogram, galvanic skin response, and eye tracking. The paper provides an introduction to various emotion models, stimuli used for emotion elicitation, and the background of existing automated emotion recognition systems. This paper covers comprehensive searching and scanning of wellknown datasets followed by design criteria for review. After a thorough analysis and discussion, we selected 142 journal articles using PRISMA guidelines. The review provides a detailed analysis of existing studies and available datasets of emotion recognition. Our review analysis also presented potential challenges in the existing literature and directions for future research.
引用
收藏
页数:36
相关论文
共 50 条
  • [41] A systematic review on research utilising artificial intelligence for open source intelligence (OSINT) applications
    Browne, Thomas Oakley
    Abedin, Mohammad
    Chowdhury, Mohammad Jabed Morshed
    [J]. INTERNATIONAL JOURNAL OF INFORMATION SECURITY, 2024, 23 (04) : 2911 - 2938
  • [42] Artificial Intelligence in Nutrients Science Research: A Review
    Sak, Jaroslaw
    Suchodolska, Magdalena
    [J]. NUTRIENTS, 2021, 13 (02) : 1 - 17
  • [43] Applications of artificial intelligence/machine learning approaches in cardiovascular medicine: a systematic review with recommendations
    Friedrich, Sarah
    Gross, Stefan
    Koenig, Inke R.
    Engelhardt, Sandy
    Bahls, Martin
    Heinz, Judith
    Huber, Cynthia
    Kaderali, Lars
    Kelm, Marcus
    Leha, Andreas
    Ruehl, Jasmin
    Schaller, Jens
    Scherer, Clemens
    Vollmer, Marcus
    Seidler, Tim
    Friede, Tim
    [J]. EUROPEAN HEART JOURNAL - DIGITAL HEALTH, 2021, 2 (03): : 424 - 436
  • [44] Prevalence of Helicobacter pylori infection in China from 2014-2023: A systematic review and meta-analysis
    Xie, Lu
    Liu, Guang-Wei
    Liu, Ya-Nan
    Li, Peng-Yu
    Hu, Xin-Ning
    He, Xin-Yi
    Huan, Rui-Bo
    Zhao, Tai-Long
    Guo, Hui-Jun
    [J]. WORLD JOURNAL OF GASTROENTEROLOGY, 2024, 30 (43) : 4636 - 4656
  • [45] Systematic Review: Emotion Recognition Based on Electrophysiological Patterns for Emotion Regulation Detection
    Duville, Mathilde Marie
    Perez, Yeremi
    Hugues-Gudino, Rodrigo
    Naal-Ruiz, Norberto E.
    Alonso-Valerdi, Luz Maria
    Ibarra-Zarate, David I.
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [46] Water treatment and artificial intelligence techniques: a systematic literature review research
    Ismail, Waidah
    Niknejad, Naghmeh
    Bahari, Mahadi
    Hendradi, Rimuljo
    Zaizi, Nurzi Juana Mohd
    Zulkifli, Mohd Zamani
    [J]. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2023, 30 (28) : 71794 - 71812
  • [47] Basic emotion detection accuracy using artificial intelligence approaches in facial emotions recognition system: A systematic review
    Hsu, Chia-Feng
    Mudiyanselage, Sriyani Padmalatha Konara
    Agustina, Rismia
    Lin, Mei-Feng
    [J]. APPLIED SOFT COMPUTING, 2025, 172
  • [48] Datasets for Automated Affect and Emotion Recognition from Cardiovascular Signals Using Artificial Intelligence- A Systematic Review
    Jemiolo, Pawel
    Storman, Dawid
    Mamica, Maria
    Szymkowski, Mateusz
    Zabicka, Wioletta
    Wojtaszek-Glowka, Magdalena
    Ligeza, Antoni
    [J]. SENSORS, 2022, 22 (07)
  • [49] A review of artificial intelligence methods enabled music-evoked EEG emotion recognition and their applications
    Su, Yan
    Liu, Yong
    Xiao, Yan
    Ma, Jiaqi
    Li, Dezhao
    [J]. FRONTIERS IN NEUROSCIENCE, 2024, 18
  • [50] Artificial intelligence in mammography: a systematic review of the external validation
    Souza Castelo Branco, Paulo Eduardo
    Silva Franco, Adriane Helena
    de Oliveira, Amanda Prates
    Costa Carneiro, Isabela Mauricio
    Costa de Carvalho, Luciana Mauricio
    Nunes de Souza, Jonathan Igor
    Leandro, Danniel Rodrigo
    Candido, Eduardo Batista
    [J]. REVISTA BRASILEIRA DE GINECOLOGIA E OBSTETRICIA, 2024, 46 : 1 - 7