Face re-identification challenge: Are face recognition models good enough?

被引:18
作者
Cheng, Zhiyi [1 ]
Zhu, Xiatian [3 ]
Gong, Shaogang [2 ]
机构
[1] Queen Mary Univ London, London, England
[2] Queen Mary Univ London, Visual Computat, London, England
[3] Vis Semant Ltd, London, England
基金
“创新英国”项目;
关键词
Face re-identification; Surveillance facial imagery; Low-resolution; Super-resolution; Open-set matching; Deep learning; Face recognition; NEURAL-NETWORK; SINGLE-IMAGE; SUPERRESOLUTION; REPRESENTATION; HALLUCINATION; PATTERNS;
D O I
10.1016/j.patcog.2020.107422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face re-identification (Re-ID) aims to track the same individuals over space and time with subtle identity class information in automatically detected face images captured by unconstrained surveillance camera views. Despite significant advances of face recognition systems for constrained social media facial images, face Re-ID is more challenging due to poor-quality surveillance face imagery data and remains under-studied. However, solving this problem enables a wide range of practical applications, ranging from law enforcement and information security to business, entertainment and e-commerce. To facilitate more studies on face Re-ID towards practical and robust solutions, a true large scale Surveillance Face Re-ID benchmark (SurvFace) is introduced, characterised by natively low-resolution, motion blur, uncontrolled poses, varying occlusion, poor illumination, and background clutters. This new benchmark is the largest and more importantly the only true surveillance face Re-ID dataset to our best knowledge, where facial images are captured and detected under realistic surveillance scenarios. We show that the current state-of-the-art FR methods are surprisingly poor for face Re-ID. Besides, face Re-ID is generally more difficult in an open-set setting as naturally required in surveillance scenarios, owing to a large number of non-target people (distractors) appearing in open ended scenes. Moreover, the low-resolution problem inherent to surveillance facial imagery is investigated. Finally, we discuss open research problems that need to be solved in order to overcome the under-studied face Re-ID problem. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 131 条
[81]  
Ng HW, 2014, IEEE IMAGE PROC, P343, DOI 10.1109/ICIP.2014.7025068
[82]   A Survey on Transfer Learning [J].
Pan, Sinno Jialin ;
Yang, Qiang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2010, 22 (10) :1345-1359
[83]  
Parkhi O. M., 2015, BMVC 2015 P BRIT MAC, P1
[84]  
Phillips P.J., 2011, Handbook of Face Recognition, P551, DOI [DOI 10.1007/978-0-85729-932-1_21, 10.1007/978-0-85729-932-1_21]
[85]   FRVT 2006 and ICE 2006 Large-Scale Experimental Results [J].
Phillips, P. Jonathon ;
Scruggs, W. Todd ;
O'Toole, Alice J. ;
Flynn, Patrick J. ;
Bowyer, Kevin W. ;
Schott, Cathy L. ;
Sharpe, Matthew .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (05) :831-846
[86]  
Phillips PJ, 2005, PROC CVPR IEEE, P947
[87]   The FERET evaluation methodology for face-recognition algorithms [J].
Phillips, PJ ;
Moon, H ;
Rizvi, SA ;
Rauss, PJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2000, 22 (10) :1090-1104
[88]   Coupled Kernel Embedding for Low-Resolution Face Image Recognition [J].
Ren, Chuan-Xian ;
Dai, Dao-Qing ;
Yan, Hong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (08) :3770-3783
[89]  
Ricanek K, 2006, PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION - PROCEEDINGS OF THE SEVENTH INTERNATIONAL CONFERENCE, P341
[90]  
Roth PM, 2014, ADV COMPUT VIS PATT, P247, DOI 10.1007/978-1-4471-6296-4_12