Deep-Person: Learning discriminative deep features for person Re-Identification

被引:191
作者
Bai, Xiang [1 ]
Yang, Mingkun [1 ]
Huang, Tengteng [1 ]
Dou, Zhiyong [1 ]
Yu, Rui [1 ]
Xu, Yongchao [1 ]
机构
[1] HUST, Sch Elect Informat & Commun, Wuhan 430074, Hubei, Peoples R China
关键词
Person Re-ID; LSTM; Triplet loss; End-to-end; NEURAL-NETWORK;
D O I
10.1016/j.patcog.2019.107036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (Re-ID) requires discriminative features focusing on the full person to cope with inaccurate person bounding box detection, background clutter, and occlusion. Many recent person Re-ID methods attempt to learn such features describing full person details via part-based feature representation. However, the spatial context between these parts is ignored for the independent extractor on each separate part. In this paper, we propose to apply Long Short-Term Memory (LSTM) in an end-to-end way to model the pedestrian, seen as a sequence of body parts from head to foot. Integrating the contextual information strengthens the discriminative ability of local feature aligning better to full person. We also leverage the complementary information between local and global feature. Furthermore, we integrate both identification task and ranking task in one network, where a discriminative embedding and a similarity measurement are learned concurrently. This results in a novel three-branch framework named Deep-Person, which learns highly discriminative features for person Re-ID. Experimental results demonstrate that Deep-Person outperforms the state-of-the-art methods by a large margin on three challenging datasets including Market-1501, CUHK03, and DukeMTMC-reID. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 66 条
[41]   Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline) [J].
Sun, Yifan ;
Zheng, Liang ;
Yang, Yi ;
Tian, Qi ;
Wang, Shengjin .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :501-518
[42]   SVDNet for Pedestrian Retrieval [J].
Sun, Yifan ;
Zheng, Liang ;
Deng, Weijian ;
Wang, Shengjin .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3820-3828
[43]  
Sutskever I, 2014, ADV NEUR IN, V27
[44]   A Siamese Long Short-Term Memory Architecture for Human Re-identification [J].
Varior, Rahul Rama ;
Shuai, Bing ;
Lu, Jiwen ;
Xu, Dong ;
Wang, Gang .
COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 :135-153
[45]   Gated Siamese Convolutional Neural Network Architecture for Human Re-identification [J].
Varior, Rahul Rama ;
Haloi, Mrinal ;
Wang, Gang .
COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 :791-808
[46]   Joint Learning of Single-image and Cross-image Representations for Person Re-identification [J].
Wang, Faqiang ;
Zuo, Wangmeng ;
Lin, Liang ;
Zhang, David ;
Zhang, Lei .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1288-1296
[47]   CNN-RNN: A Unified Framework for Multi-label Image Classification [J].
Wang, Jiang ;
Yang, Yi ;
Mao, Junhua ;
Huang, Zhiheng ;
Huang, Chang ;
Xu, Wei .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2285-2294
[48]   Equidistance constrained metric learning for person re-identification [J].
Wang, Jin ;
Wang, Zheng ;
Liang, Chao ;
Gao, Changxin ;
Sang, Nong .
PATTERN RECOGNITION, 2018, 74 :38-51
[49]   What-and-where to match: Deep spatially multiplicative integration networks for person re-identification [J].
Wu, Lin ;
Wang, Yang ;
Li, Xue ;
Gao, Junbin .
PATTERN RECOGNITION, 2018, 76 :727-738
[50]   Progressive Learning for Person Re-Identification With One Example [J].
Wu, Yu ;
Lin, Yutian ;
Dong, Xuanyi ;
Yan, Yan ;
Bian, Wei ;
Yang, Yi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) :2872-2881