Discriminative Deep Metric Learning for Face and Kinship Verification

被引:222
作者
Lu, Jiwen [1 ,2 ]
Hu, Junlin [3 ]
Tan, Yap-Peng [3 ]
机构
[1] Tsinghua Univ, Dept Automat, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[2] Tsinghua Natl Lab Informat Sci & Technol TNList, Beijing 100084, Peoples R China
[3] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Face verification; kinship verification; deep learning; deep metric learning; multi-feature learning; RECOGNITION;
D O I
10.1109/TIP.2017.2717505
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new discriminative deep metric learning (DDML) method for face and kinship verification in wild conditions. While metric learning has achieved reasonably good performance in face and kinship verification, most existing metric learning methods aim to learn a single Mahalanobis distance metric to maximize the inter-class variations and minimize the intra-class variations, which cannot capture the nonlinear manifold where face images usually lie on. To address this, we propose a DDML method to train a deep neural network to learn a set of hierarchical nonlinear transformations to project face pairs into the same latent feature space, under which the distance of each positive pair is reduced and that of each negative pair is enlarged. To better use the commonality of multiple feature descriptors to make all the features more robust for face and kinship verification, we develop a discriminative deep multimetric learning method to jointly learn multiple neural networks, under which the correlation of different features of each sample is maximized, and the distance of each positive pair is reduced and that of each negative pair is enlarged. Extensive experimental results show that our proposed methods achieve the acceptable results in both face and kinship verification.
引用
收藏
页码:4269 / 4282
页数:14
相关论文
共 68 条
[1]  
Ahonen T, 2008, ICPR2009, P1, DOI DOI 10.1109/ICPR.2008.4761847
[2]   Face description with local binary patterns:: Application to face recognition [J].
Ahonen, Timo ;
Hadid, Abdenour ;
Pietikainen, Matti .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :2037-2041
[3]  
[Anonymous], 2008, P 2008 INT C CONTENT, DOI DOI 10.1145/1386352.1386373
[4]  
[Anonymous], 2013, IEEE T PATTERN ANAL, DOI DOI 10.1109/TPAMI.2012.59
[5]  
[Anonymous], 2012, P 20 ACM INT C MULT
[6]  
[Anonymous], 2013, P INT C BIOM ICB
[7]  
[Anonymous], P ADV NEURAL INFORM
[8]  
[Anonymous], 2009, ICML
[9]  
[Anonymous], 2012, P 20 ACM INT C MULT, DOI [DOI 10.1145/2393347.2396297, DOI 10.1145/2393347]
[10]   Fast High Dimensional Vector Multiplication Face Recognition [J].
Barkan, Oren ;
Weill, Jonathan ;
Wolf, Lior ;
Aronowitz, Hagai .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :1960-1967