Discriminative Deep Metric Learning for Face and Kinship Verification

被引:222
作者
Lu, Jiwen [1 ,2 ]
Hu, Junlin [3 ]
Tan, Yap-Peng [3 ]
机构
[1] Tsinghua Univ, Dept Automat, State Key Lab Intelligent Technol & Syst, Beijing 100084, Peoples R China
[2] Tsinghua Natl Lab Informat Sci & Technol TNList, Beijing 100084, Peoples R China
[3] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Face verification; kinship verification; deep learning; deep metric learning; multi-feature learning; RECOGNITION;
D O I
10.1109/TIP.2017.2717505
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new discriminative deep metric learning (DDML) method for face and kinship verification in wild conditions. While metric learning has achieved reasonably good performance in face and kinship verification, most existing metric learning methods aim to learn a single Mahalanobis distance metric to maximize the inter-class variations and minimize the intra-class variations, which cannot capture the nonlinear manifold where face images usually lie on. To address this, we propose a DDML method to train a deep neural network to learn a set of hierarchical nonlinear transformations to project face pairs into the same latent feature space, under which the distance of each positive pair is reduced and that of each negative pair is enlarged. To better use the commonality of multiple feature descriptors to make all the features more robust for face and kinship verification, we develop a discriminative deep multimetric learning method to jointly learn multiple neural networks, under which the correlation of different features of each sample is maximized, and the distance of each positive pair is reduced and that of each negative pair is enlarged. Extensive experimental results show that our proposed methods achieve the acceptable results in both face and kinship verification.
引用
收藏
页码:4269 / 4282
页数:14
相关论文
共 68 条
[11]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[12]  
Blaschko M. B., 2008, PROC IEEE C COMPUT V, P1
[13]  
Borga M., 2001, CANONICAL CORRELATIO
[14]   Similarity Metric Learning for Face Recognition [J].
Cao, Qiong ;
Ying, Yiming ;
Li, Peng .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2408-2415
[15]  
Chen D, 2012, LECT NOTES COMPUT SC, V7574, P566, DOI 10.1007/978-3-642-33712-3_41
[16]   Blessing of Dimensionality: High-dimensional Feature and Its Efficient Compression for Face Verification [J].
Chen, Dong ;
Cao, Xudong ;
Wen, Fang ;
Sun, Jian .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3025-3032
[17]   Fusing Robust Face Region Descriptors via Multiple Metric Learning for Face Recognition in the Wild [J].
Cui, Zhen ;
Li, Wen ;
Xu, Dong ;
Shan, Shiguang ;
Chen, Xilin .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3554-3561
[18]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[19]  
Davis J.V., 2007, P 24 INT C MACHINE L, P209, DOI DOI 10.1145/1273496.1273523
[20]   Like Father, Like Son: Facial Expression Dynamics for Kinship Verification [J].
Dibeklioglu, Hamdi ;
Salah, Albert Ali ;
Gevers, Theo .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :1497-1504