Bi-Directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification

被引:251
作者
Ye, Mang [1 ]
Lan, Xiangyuan [1 ]
Wang, Zheng [2 ]
Yuen, Pong C. [1 ]
机构
[1] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
[2] Natl Inst Informat, Tokyo 1018430, Japan
关键词
Person re-identification (REID); cross-modality; visible thermal (VT); top-ranking; COUPLED DICTIONARY; FACE; IMAGE; NETWORKS;
D O I
10.1109/TIFS.2019.2921454
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Visible thermal person re-identification (VT-REID) is a task of matching person images captured by thermal and visible cameras, which is an extremely important issue in night-time surveillance applications. Existing cross-modality recognition works mainly focus on learning shamble feature representations to handle the cross-modality discrepancies. However, apart from the cross-modality discrepancy caused by different camera spectrums, VT-REID also suffers from large cross-modality and intra-modality variations caused by different camera environments and human poses, and so on. In this paper, we propose a dual-path network with a novel bi-directional dual-constrained top-ranking (BDTR) loss to learn discriminative feature representations. It is featured in two aspects: 1) end-to-end learning without extra metric learning step and 2) the dual-constraint simultaneously handles the cross-modality and intra-modality variations to ensure the feature discriminability. Meanwhile, a bi-directional center-constrained top-ranking (eBDTR) is proposed to incorporate the previous two constraints into a single formula, which preserves the properties to handle both cross-modality and intra-modality variations. The extensive experiments on two cross-modality re-ID datasets demonstrate the superiority of the proposed method compared to the state-of-the-arts.
引用
收藏
页码:407 / 419
页数:13
相关论文
共 62 条
[1]  
[Anonymous], PATTERN RECOGNIT LET
[2]  
[Anonymous], 2017, ARXIV170307220
[3]  
[Anonymous], 2016, ARXIV
[4]  
[Anonymous], IEEE T IND ELECT
[5]  
[Anonymous], IEEE T CIRCUITS SYST
[6]  
Barbosa IB, 2012, LECT NOTES COMPUT SC, V7583, P433, DOI 10.1007/978-3-642-33863-2_43
[7]   Unconstrained Face Recognition: Identifying a Person of Interest From a Media Collection [J].
Best-Rowden, Lacey ;
Han, Hu ;
Otto, Charles ;
Klare, Brendan F. ;
Jain, Anil K. .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2014, 9 (12) :2144-2157
[8]   Person Re-Identification by Camera Correlation Aware Feature Augmentation [J].
Chen, Ying-Cong ;
Zhu, Xiatian ;
Zheng, Wei-Shi ;
Lai, Jian-Huang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (02) :392-408
[9]  
Dai PY, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P677
[10]   Learning View-Specific Deep Networks for Person Re-Identification [J].
Feng, Zhanxiang ;
Lai, Jianhuang ;
Xie, Xiaohua .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (07) :3472-3483