Facial Micro-Expressions: An Overview

被引:4
作者
Zhao, Guoying [1 ]
Li, Xiaobai [1 ]
Li, Yante [1 ]
Pietikainen, Matti [1 ]
机构
[1] Univ Oulu, Ctr Machine Vis & Signal Anal, Oulu 90570, Finland
基金
芬兰科学院;
关键词
Affective computing; computer vision; machine learning; micro-expression (ME); survey; CONVOLUTIONAL NEURAL-NETWORK; LOCAL BINARY PATTERNS; OPTICAL-FLOW; RECOGNITION; EMOTION; INFORMATION; FACE; DATABASE; RESNET; MODEL;
D O I
10.1109/JPROC.2023.3275192
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Micro-expression (ME) is an involuntary, fleeting, and subtle facial expression. It may occur in high-stake situations when people attempt to conceal or suppress their true feelings. Therefore, MEs can provide essential clues to people's true feelings and have plenty of potential applications, such as national security, clinical diagnosis, and interrogations. In recent years, ME analysis has gained much attention in various fields due to its practical importance, especially automatic ME analysis in computer vision as MEs are difficult to process by naked eyes. In this survey, we provide a comprehensive review of ME development in the field of computer vision, from the ME studies in psychology and early attempts in computer vision to various computational ME analysis methods and future directions. Four main tasks in ME analysis are specifically discussed, including ME spotting, ME recognition, ME action unit detection, and ME generation in terms of the approaches, advance developments, and challenges. Through this survey, readers can understand MEs in both aspects of psychology and computer vision, and apprehend the future research direction in ME analysis.
引用
收藏
页码:1215 / 1235
页数:21
相关论文
共 228 条
  • [1] Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?
    Abdal, Rameen
    Qin, Yipeng
    Wonka, Peter
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4431 - 4440
  • [2] Covariance Pooling for Facial Expression Recognition
    Acharya, Dinesh
    Huang, Zhiwu
    Paudel, Danda Pani
    Van Gool, Luc
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 480 - 487
  • [3] Allaert B, 2022, Arxiv, DOI arXiv:1904.11592
  • [4] Consistent Optical Flow Maps for Full and Micro Facial Expression Recognition
    Allaert, Benjamin
    Bilasco, Ioan Marius
    Djeraba, Chabane
    [J]. PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 5, 2017, : 235 - 242
  • [5] Amsel T. T., 2019, An Urban Legend Called: 'The 7/38/55Ratio Rule', V13, P95
  • [6] [Anonymous], 2015, P BRIT MACH VIS C BM
  • [7] [Anonymous], 2014, AS C COMP VIS
  • [8] [Anonymous], 2013, Our children deserve better: prevention pays (annual report of the Chief Medical Officer 2012)
  • [9] [Anonymous], 2012, PAR MENT ILLN PROBL
  • [10] Robust Discriminative Response Map Fitting with Constrained Local Models
    Asthana, Akshay
    Zafeiriou, Stefanos
    Cheng, Shiyang
    Pantic, Maja
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 3444 - 3451