DFME: A New Benchmark for Dynamic Facial Micro-Expression Recognition

被引:0
作者
Zhao, Sirui [1 ,2 ]
Tang, Huaying [1 ,3 ]
Mao, Xinglong [3 ]
Liu, Shifeng [3 ]
Zhang, Yiming [3 ]
Wang, Hao [3 ]
Xu, Tong [3 ]
Chen, Enhong [3 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Peoples R China
[3] Univ Sci & Technol China, Sch Data Sci, Hefei 230027, Anhui, Peoples R China
基金
中国国家自然科学基金;
关键词
Databases; Videos; Psychology; Face recognition; Computer science; Spatiotemporal phenomena; Representation learning; Emotion recognition; facial micro-expression; facial action units; micro-expression recognition; databases; OPTICAL-FLOW; INFORMATION;
D O I
10.1109/TAFFC.2023.3341918
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
One of the most important subconscious reactions, micro-expression (ME), is a spontaneous, subtle, and transient facial expression that reveals human beings' genuine emotion. Therefore, automatically recognizing ME (MER) is becoming increasingly crucial in the field of affective computing, providing essential technical support for lie detection, clinical psychological diagnosis, and public safety. However, the ME data scarcity has severely hindered the development of advanced data-driven MER models. Despite the recent efforts by several spontaneous ME databases to alleviate this problem, there is still a lack of sufficient data. Hence, in this paper, we overcome the ME data scarcity problem by collecting and annotating a dynamic spontaneous ME database with the largest current ME data scale called DFME (Dynamic Facial Micro-expressions). Specifically, the DFME database contains 7,526 well-labeled ME videos spanning multiple high frame rates, elicited by 671 participants and annotated by more than 20 professional annotators over three years. Furthermore, we comprehensively verify the created DFME, including using influential spatiotemporal video feature learning models and MER models as baselines, and conduct emotion classification and ME action unit classification experiments. The experimental results demonstrate that the DFME database can facilitate research in automatic MER, and provide a new benchmark for this field.
引用
收藏
页码:1371 / 1386
页数:16
相关论文
共 83 条
  • [1] Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms
    Ben, Xianye
    Ren, Yi
    Zhang, Junping
    Wang, Su-Jing
    Kpalma, Kidiyo
    Meng, Weixiao
    Liu, Yong-Jin
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5826 - 5846
  • [2] Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
    Carreira, Joao
    Zisserman, Andrew
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4724 - 4733
  • [3] Chaudhry R, 2009, PROC CVPR IEEE, P1932, DOI 10.1109/CVPRW.2009.5206821
  • [4] SAMM: A Spontaneous Micro-Facial Movement Dataset
    Davison, Adrian K.
    Lansley, Cliff
    Costen, Nicholas
    Tan, Kevin
    Yap, Moi Hoon
    [J]. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2018, 9 (01) : 116 - 129
  • [5] Deng JK, 2019, Arxiv, DOI [arXiv:1905.00641, 10.48550/ARXIV.1905.00641]
  • [6] Style Aggregated Network for Facial Landmark Detection
    Dong, Xuanyi
    Yan, Yan
    Ouyang, Wanli
    Yang, Yi
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 379 - 388
  • [7] NONVERBAL LEAKAGE AND CLUES TO DECEPTION
    EKMAN, P
    FRIESEN, WV
    [J]. PSYCHIATRY, 1969, 32 (01) : 88 - +
  • [8] Ekman P., 1985, Telling lies: Clues to Deceit in the Marketplace, DOI DOI 10.1080/00029157.2011.10404358
  • [9] Ekman P., 1978, Environmental Psychology and Nonverbal Behavior
  • [10] Micro-expression recognition training in medical students: a pilot study
    Endres, Jennifer
    Laidlaw, Anita
    [J]. BMC MEDICAL EDUCATION, 2009, 9