A Two Stream Siamese Convolutional Neural Network For Person Re-Identification

被引:200
作者
Chung, Dahjung [1 ]
Tahboub, Khalid [1 ]
Delp, Edward J. [1 ]
机构
[1] Purdue Univ, Sch Elect & Comp Engn, Video & Image Proc Lab VIPER, W Lafayette, IN 47907 USA
来源
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) | 2017年
关键词
D O I
10.1109/ICCV.2017.218
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification is an important task in video surveillance systems. It can be formally defined as establishing the correspondence between images of a person taken from different cameras at different times. In this paper, we present a two stream convolutional neural network where each stream is a Siamese network. This architecture can learn spatial and temporal information separately. We also propose a weighted two stream training objective function which combines the Siamese cost of the spatial and temporal streams with the objective of predicting a person's identity. We evaluate our proposed method on the publicly available PRID2011 and iLIDS-VID datasets and demonstrate the efficacy of our proposed method. On average, the top rank matching accuracy is 4% higher than the accuracy achieved by the cross-view quadratic discriminant analysis used in combination with the hierarchical Gaussian descriptor (GOG+XQDA), and 5% higher than the recurrent neural network method.
引用
收藏
页码:1992 / 2000
页数:9
相关论文
共 41 条
[31]   Deep Learning Face Representation from Predicting 10,000 Classes [J].
Sun, Yi ;
Wang, Xiaogang ;
Tang, Xiaoou .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1891-1898
[32]  
Tahboub K, 2016, IEEE IMAGE PROC, P764, DOI 10.1109/ICIP.2016.7532460
[33]   Joint Learning of Single-image and Cross-image Representations for Person Re-identification [J].
Wang, Faqiang ;
Zuo, Wangmeng ;
Lin, Liang ;
Zhang, David ;
Zhang, Lei .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1288-1296
[34]  
Wang TQ, 2014, LECT NOTES COMPUT SC, V8692, P688, DOI 10.1007/978-3-319-10593-2_45
[35]   Viewpoint Invariant Human Re-Identification in Camera Networks Using Pose Priors and Subject-Discriminative Features [J].
Wu, Ziyan ;
Li, Yang ;
Radke, Richard J. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (05) :1095-1108
[36]   Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification [J].
Xiao, Tong ;
Li, Hongsheng ;
Ouyang, Wanli ;
Wang, Xiaogang .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1249-1258
[37]   Person Re-Identification Using Kernel-Based Metric Learning Methods [J].
Xiong, Fei ;
Gou, Mengran ;
Camps, Octavia ;
Sznaier, Mario .
COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 :1-16
[38]   Deep Metric Learning for Person Re-Identification [J].
Yi, Dong ;
Lei, Zhen ;
Liao, Shengcai ;
Li, Stan Z. .
2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, :34-39
[39]   Top-push Video-based Person Re-identification [J].
You, Jinjie ;
Wu, Ancong ;
Li, Xiang ;
Zheng, Wei-Shi .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1345-1353
[40]  
Zheng L., 2016, P EUR C COMP VIS OCT