A main directional maximal difference analysis for spotting facial movements from long-term videos

被引:60
作者
Wang, Su-Jing [1 ]
Wu, Shuhang [2 ]
Qian, Xingsheng [1 ]
Li, Jingxiu [3 ]
Fu, Xiaolan [4 ,5 ]
机构
[1] Inst Psychol, CAS Key Lab Behav Sci, Beijing 100101, Peoples R China
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang, Peoples R China
[3] Harbin Med Univ, Affiliated Hosp 4, Dept Cardiol, Harbin 150001, Peoples R China
[4] Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
[5] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Micro-expression recognition; Macro-expression; Micro-expression spotting; Optical flow; RECOGNITION; SCHIZOPHRENIA; REMEDIATION; DECEPTION;
D O I
10.1016/j.neucom.2016.12.034
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There is an increasing interests in micro-expression researches. Spotting micro-expressions in long-term videos is very important, not only for providing clues for lie detection, but also for reducing the labor required to collect micro-expression data. However, little progress has been made in spotting micro-expressions. In this paper, we propose a Main Directional Maximal Difference (MDMD) Analysis for micro-expression spotting. MDMD uses the magnitude maximal difference in the main direction of optical flow features to spot facial movements, including micro-expressions. Using block structured facial regions, MDMD obtains more accurate features of movement of expressions for automatically spotting micro-expressions and macro-expressions from videos. This method involves both the temporal and spatial locations of face movements. Evaluations using the CAS(ME)(2) database containing micro-expressions and macro-expressions show that MDMD is more robust than some state-of-the-art algorithms.
引用
收藏
页码:382 / 389
页数:8
相关论文
共 38 条
[1]  
[Anonymous], 2005, EXPRESS EMOT MAN, DOI DOI 10.1037/10001-000
[2]  
[Anonymous], 2009, TELLING LIES CLUES D
[3]  
[Anonymous], 2014, ECCV WORKSH ZUR, DOI DOI 10.1007/978-3-319-16178-5_23
[4]  
[Anonymous], 2001, PYRAMIDAL IMPLEMENTA
[5]  
[Anonymous], 2009, The philosophy of deception, DOI [10.1093/acprof:oso/9780195327939.003.0008, DOI 10.1093/ACPROF:OSO/9780195327939.003.0008]
[6]   Robust Discriminative Response Map Fitting with Constrained Local Models [J].
Asthana, Akshay ;
Zafeiriou, Stefanos ;
Cheng, Shiyang ;
Pantic, Maja .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3444-3451
[7]  
Black M.J., 1996, COMPUT VIS IMAGE UND, V63
[8]   Micro-Facial Movement Detection Using Individualised Baselines and Histogram-Based Descriptors [J].
Davison, Adrian K. ;
Yap, Moi Hoon ;
Lansley, Cliff .
2015 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2015): BIG DATA ANALYTICS FOR HUMAN-CENTRIC SYSTEMS, 2015, :1864-1869
[9]   NONVERBAL LEAKAGE AND CLUES TO DECEPTION [J].
EKMAN, P ;
FRIESEN, WV .
PSYCHIATRY, 1969, 32 (01) :88-+
[10]  
Ekman P., FACIAL ACTION CODING