Multi-task mid-level feature learning for micro-expression recognition

被引:37
作者
He, Jiachi [1 ]
Hu, Jian-Fang [2 ,3 ]
Lu, Xi [2 ,4 ]
Zheng, Wei-Shi [2 ,5 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Informat Engn, Guangzhou 510006, Guangdong, Peoples R China
[2] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510006, Guangdong, Peoples R China
[3] Guangdong Prov Key Lab Informat Secur, Guangzhou, Guangdong, Peoples R China
[4] Natl Univ Def Technol, Collaborat Innovat Ctr High Performance Comp, Changsha 410073, Hunan, Peoples R China
[5] Sun Yat Sen Univ, Key Lab Machine Intelligence & Adv Comp, Minist Educ, Guangzhou, Guangdong, Peoples R China
关键词
Micro-expression recognition; Multi-task learning;
D O I
10.1016/j.patcog.2016.11.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the short duration and low intensity of micro-expressions, the recognition of micro-expression is still a challenging problem. In this paper, we develop a novel multi-task mid-level feature learning method to enhance the discrimination ability of extracted low-level features by learning a set of class-specific feature mappings, which would be used for generating our mid-level feature representation. Moreover, two weighting schemes are employed to concatenate different mid-level features. We also construct a new mobile micro-expression set to evaluate the performance of the proposed mid-level feature learning framework. The experimental results on two widely used non-mobile micro-expression datasets and one mobile micro-expression set demonstrate that the proposed method can generally improve the performance of the low-level features, and achieve comparable results with the state-of-the-art methods.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 37 条
[1]  
[Anonymous], 2014, ACCV, DOI DOI 10.1007/978-3-319-16865-4_34
[2]  
[Anonymous], 2004, 6 INT C MULTIMODAL I
[3]  
[Anonymous], 2014, ACCV WORKSH SING, DOI DOI 10.1007/978-3-319-16631-5_47
[4]  
[Anonymous], BEHAV SECURITY PROTE
[5]  
[Anonymous], 2014, P 2014 ASIAN C COMPU
[6]  
[Anonymous], 2014, ECCV WORKSH ZUR, DOI DOI 10.1007/978-3-319-16178-5_23
[7]  
[Anonymous], IEEE T AFFECT COMPUT
[8]  
[Anonymous], 2015, PLOS ONE
[9]  
[Anonymous], 2002, Microexpression training tool (METT)
[10]  
[Anonymous], 2011, ACM T INTEL SYST TEC, DOI DOI 10.1145/1961189.1961199