Efficient Micro-Expression Spotting Based on Main Directional Mean Optical Flow Feature

被引:2
作者
Yu, Jun [1 ]
Cai, Zhongpeng [1 ]
Du, Shenshen [1 ]
Shen, Xiaxin [1 ]
Wang, Lei [1 ]
Gao, Fang [2 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Guangxi Univ, Nanning, Peoples R China
来源
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023 | 2023年
关键词
Optical Flow; Expression Spotting; Micro expression; Macro expression;
D O I
10.1145/3581783.3612861
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human facial expressions can convey a great deal of information in daily life. Spotting macro-expression (MaE) and micro-expression (ME) intervals from long video sequences is a difficult challenge. In this paper, we propose an efficient framework for the expression spotting task. This framework consists of three main modules: Face Cropping and Alignment Module (FCAM), optical flow Feature Extraction Module (FEM), and expression Proposal Generation Module (PGM). The noise of optical flow features is reduced by face cropping and alignment, and the Main Directional Mean Optical Flow Feature of the regions of interest is extracted as the feature for expression spotting. Finally, the expression intervals are spotted by our designed expression proposal generation module. Our approach achieves very good results on the SAMM Long Videos and CAS(ME)2. To demonstrate the transferability of our method, we tested it on the MEGC2023 unseen dataset and finally achieved the third place, proving the effectiveness of our method.
引用
收藏
页码:9541 / 9545
页数:5
相关论文
共 26 条
[1]  
[Anonymous], PROC CVPR IEEE
[2]   SAMM: A Spontaneous Micro-Facial Movement Dataset [J].
Davison, Adrian K. ;
Lansley, Cliff ;
Costen, Nicholas ;
Tan, Kevin ;
Yap, Moi Hoon .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2018, 9 (01) :116-129
[3]   RetinaFace: Single-shot Multi-level Face Localisation in the Wild [J].
Deng, Jiankang ;
Guo, Jia ;
Ververas, Evangelos ;
Kotsia, Irene ;
Zafeiriou, Stefanos .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5202-5211
[4]  
Friesen E., 1978, Environmental Psychology Nonverbal Behavior, DOI DOI 10.1037/T27734-000
[5]   Research on Micro-Expression Spotting Method Based on Optical Flow Features [J].
He Yuhong .
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, :4803-4807
[6]  
Ju QC, 2022, COMMUN MATH SCI, V20, P1637, DOI 10.4310/CMS.2022.v20.n6.a8
[7]  
King DE, 2009, J MACH LEARN RES, V10, P1755
[8]   ABPN: Apex and Boundary Perception Network for Micro- and Macro-Expression Spotting [J].
Leng, Wenhao ;
Zhao, Sirui ;
Zhang, Yiming ;
Liu, Shifeng ;
Mao, Xinglong ;
Wang, Hao ;
Xu, Tong ;
Chen, Enhong .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, :7160-7164
[9]  
Li J., 2022, IEEE transactions on pattern analysis and machine intelligence
[10]   LTP-ML : Micro-Expression Detection by Recognition of Local temporal Pattern of Facial Movements [J].
Li, Jingting ;
Soladie, Catherine ;
Seguier, Renaud .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :634-641