A comprehensive review of facial expression recognition techniques

被引:29
作者
Adyapady, R. Rashmi [1 ]
Annappa, B. [1 ]
机构
[1] Natl Inst Technol Karnataka, Dept Comp Sci & Engn, Surathkal, India
关键词
Facial expression recognition; Emotion recognition; Machine and deep learning; Constrained environment; Unconstrained environment; EMOTION RECOGNITION; AUTOMATIC RECOGNITION; DEEP; NETWORK; ATTENTION; FEATURES; ROBUST; WILD; ENGAGEMENT; FUSION;
D O I
10.1007/s00530-022-00984-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Emotion recognition has opened up many challenges, which lead to various advances in computer vision and artificial intelligence. The rapid development in this field has encouraged the development of an automatic system that could accurately analyze and measure the emotions of human beings via facial expressions. This study mainly focuses on facial expression recognition from visual cues, as visual information is the most prominent channel for social communication. The paper provides a comprehensive review of recent advancements in algorithm development, presents the overall findings performed over the past decades, discusses their advantages and constraints. It explores the transition from the laboratory-controlled environment to challenging real-world (in-the-wild) conditions, focusing on essential issues that require further exploration. Finally, relevant opportunities in this field, challenges, and future directions mentioned in this paper assist the researchers and academicians in designing efficient and robust facial expression recognition systems.
引用
收藏
页码:73 / 103
页数:31
相关论文
共 129 条
[101]   Geometric-Convolutional Feature Fusion Based on Learning Propagation for Facial Expression Recognition [J].
Tang, Yan ;
Zhang, Xing Ming ;
Wang, Haoxiang .
IEEE ACCESS, 2018, 6 :42532-42540
[102]  
Tian YL, 2005, HANDBOOK OF FACE RECOGNITION, P247, DOI 10.1007/0-387-27257-7_12
[103]   Facial Action Units-Based Image Retrieval for Facial Expression Recognition [J].
Trinh Thi Doan Pham ;
Kim, Sesong ;
Lu, Yucheng ;
Jung, Seung-Won ;
Won, Chee-Sun .
IEEE ACCESS, 2019, 7 :5200-5207
[104]   Fusion of Machine Learning and Privacy Preserving for Secure Facial Expression Recognition [J].
Ullah, Asad ;
Wang, Jing ;
Anwar, M. Shahid ;
Ahmad, Arshad ;
Nazir, Shah ;
Khan, Habib Ullah ;
Fei, Zesong .
SECURITY AND COMMUNICATION NETWORKS, 2021, 2021
[105]  
Valstar MF, 2010, LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, pJ65
[106]   Meta-Analysis of the First Facial Expression Recognition Challenge [J].
Valstar, Michel F. ;
Mehu, Marc ;
Jiang, Bihan ;
Pantic, Maja ;
Scherer, Klaus .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (04) :966-979
[107]   Pyramid With Super Resolution for In-the-Wild Facial Expression Recognition [J].
Vo, Thanh-Hung ;
Lee, Guee-Sang ;
Yang, Hyung-Jeong ;
Kim, Soo-Hyung .
IEEE ACCESS, 2020, 8 :131988-132001
[108]   Suppressing Uncertainties for Large-Scale Facial Expression Recognition [J].
Wang, Kai ;
Peng, Xiaojiang ;
Yang, Jianfei ;
Lu, Shijian ;
Qiao, Yu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6896-6905
[109]   Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition [J].
Wang, Kai ;
Peng, Xiaojiang ;
Yang, Jianfei ;
Meng, Debin ;
Qiao, Yu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) :4057-4069
[110]  
Wang P., 2020, P IEEECVF C COMPUTER, P412