Facial Micro-Expressions: An Overview

被引:4
作者
Zhao, Guoying [1 ]
Li, Xiaobai [1 ]
Li, Yante [1 ]
Pietikainen, Matti [1 ]
机构
[1] Univ Oulu, Ctr Machine Vis & Signal Anal, Oulu 90570, Finland
基金
芬兰科学院;
关键词
Affective computing; computer vision; machine learning; micro-expression (ME); survey; CONVOLUTIONAL NEURAL-NETWORK; LOCAL BINARY PATTERNS; OPTICAL-FLOW; RECOGNITION; EMOTION; INFORMATION; FACE; DATABASE; RESNET; MODEL;
D O I
10.1109/JPROC.2023.3275192
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Micro-expression (ME) is an involuntary, fleeting, and subtle facial expression. It may occur in high-stake situations when people attempt to conceal or suppress their true feelings. Therefore, MEs can provide essential clues to people's true feelings and have plenty of potential applications, such as national security, clinical diagnosis, and interrogations. In recent years, ME analysis has gained much attention in various fields due to its practical importance, especially automatic ME analysis in computer vision as MEs are difficult to process by naked eyes. In this survey, we provide a comprehensive review of ME development in the field of computer vision, from the ME studies in psychology and early attempts in computer vision to various computational ME analysis methods and future directions. Four main tasks in ME analysis are specifically discussed, including ME spotting, ME recognition, ME action unit detection, and ME generation in terms of the approaches, advance developments, and challenges. Through this survey, readers can understand MEs in both aspects of psychology and computer vision, and apprehend the future research direction in ME analysis.
引用
收藏
页码:1215 / 1235
页数:21
相关论文
共 228 条
  • [51] A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
    Gui, Jie
    Sun, Zhenan
    Wen, Yonggang
    Tao, Dacheng
    Ye, Jieping
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 3313 - 3332
  • [52] Guo YJ, 2014, IEEE IJCNN, P3473, DOI 10.1109/IJCNN.2014.6889620
  • [53] MERASTC: Micro-Expression Recognition Using Effective Feature Encodings and 2D Convolutional Neural Network
    Gupta, Puneet
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (02) : 1431 - 1441
  • [54] Hadsell R., 2006, PROC IEEE C COMP UIS, P1735
  • [55] Haggard E.A., 1966, Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy. Methods of research in psychotherapy, P154, DOI DOI 10.1007/978-1-4684-6045-2_14
  • [56] Fuzzy Histogram of Optical Flow Orientations for Micro-Expression Recognition
    Happy, S. L.
    Routray, Aurobinda
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) : 394 - 406
  • [57] LARNet: Real-Time Detection of Facial Micro Expression Using Lossless Attention Residual Network
    Hashmi, Mohammad Farukh
    Ashish, B. Kiran Kumar
    Sharma, Vivek
    Keskar, Avinash G.
    Bokde, Neeraj Dhanraj
    Yoon, Jin Hee
    Geem, Zong Woo
    [J]. SENSORS, 2021, 21 (04) : 1 - 23
  • [58] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [59] DIFFERENTIATING EMOTION ELICITED AND DELIBERATE EMOTIONAL FACIAL EXPRESSIONS
    HESS, U
    KLECK, RE
    [J]. EUROPEAN JOURNAL OF SOCIAL PSYCHOLOGY, 1990, 20 (05) : 369 - 385
  • [60] Hogg M. A., 2007, Tech. Rep., P684