Enhancing convolutional neural networks for face recognition with occlusion maps and batch triplet loss

被引:52
作者
Trigueros, Daniel Saez [1 ,2 ]
Meng, Li [1 ]
Hartnett, Margaret [2 ]
机构
[1] Univ Hertfordshire, Sch Engn & Technol, Hatfield AL10 9AB, Herts, England
[2] GBG Plc, London E14 9QD, England
基金
“创新英国”项目;
关键词
Face recognition; Convolutional neural networks; Facial occlusions; Distance metric learning;
D O I
10.1016/j.imavis.2018.09.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite the recent success of convolutional neural networks for computer vision applications, unconstrained face recognition remains a challenge. In this work, we make two contributions to the field. Firstly, we consider the problem of face recognition with partial occlusions and show how current approaches might suffer significant performance degradation when dealing with this kind of face images. We propose a simple method to find out which parts of the human face are more important to achieve a high recognition rate, and use that information during training to force a convolutional neural network to learn discriminative features from all the face regions more equally, including those that typical approaches tend to pay less attention to. We test the accuracy of the proposed method when dealing with real-life occlusions using the AR face database. Secondly, we propose a novel loss function called batch triplet loss that improves the performance of the triplet loss by adding an extra term to the loss function to cause minimisation of the standard deviation of both positive and negative scores. We show consistent improvement in the Labeled Faces in the Wild (LFW) benchmark by applying both proposed adjustments to the convolutional neural network training. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:99 / 108
页数:10
相关论文
共 41 条
[1]  
[Anonymous], 2016, ARXIV161208534
[2]  
[Anonymous], 2014, CoRR
[3]  
[Anonymous], 2007, Tech. rep
[4]  
Chen D, 2012, LECT NOTES COMPUT SC, V7574, P566, DOI 10.1007/978-3-642-33712-3_41
[5]   Robust Deep Auto-encoder for Occluded Face Recognition [J].
Cheng, Lele ;
Wang, Jinjun ;
Gong, Yihong ;
Hou, Qiqi .
MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, :1099-1102
[6]   Learning a similarity metric discriminatively, with application to face verification [J].
Chopra, S ;
Hadsell, R ;
LeCun, Y .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :539-546
[7]  
Daugman John., 2000, BIOMETRIC DECISION L
[8]   Robust Face Recognition via Multimodal Deep Face Representation [J].
Ding, Changxing ;
Tao, Dacheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (11) :2049-2058
[9]  
Fan H., 2014, ARXIV14032802
[10]   Deep Image Retrieval: Learning Global Representations for Image Search [J].
Gordo, Albert ;
Almazan, Jon ;
Revaud, Jerome ;
Larlus, Diane .
COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 :241-257