Person Re-Identification by Camera Correlation Aware Feature Augmentation

被引:237
作者
Chen, Ying-Cong [1 ,2 ,3 ]
Zhu, Xiatian [1 ,4 ]
Zheng, Wei-Shi [1 ,5 ]
Lai, Jian-Huang [1 ,6 ]
机构
[1] Sun Yat Sen Univ, Sch Data & Comp Sci, Guangzhou 510275, Guangdong, Peoples R China
[2] Natl Univ Def Technol, Collaborat Innovat Ctr High Performance Comp, Changsha 410073, Hunan, Peoples R China
[3] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Sha Tin, Hong Kong, Peoples R China
[4] Queen Mary Univ London, Sch Elect Engn & Comp Sci, London E1 4NS, England
[5] Sun Yat Sen Univ, Minist Educ, Key Lab Machine Intelligence & Adv Comp, Guangzhou 510275, Guangdong, Peoples R China
[6] Guangdong Prov Key Lab Informat Secur, Guangzhou 510275, Guangdong, Peoples R China
关键词
Person re-identification; adaptive feature augmentation; view-specific transformation; ADAPTATION; NETWORK;
D O I
10.1109/TPAMI.2017.2666805
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The challenge of person re-identification (re-id) is to match individual images of the same person captured by different non-overlapping camera views against significant and unknown cross-view feature distortion. While a large number of distance metric/subspace learning models have been developed for re-id, the cross-view transformations they learned are view-generic and thus potentially less effective in quantifying the feature distortion inherent to each camera view. Learning view-specific feature transformations for re-id (i.e., view-specific re-id), an under-studied approach, becomes an alternative resort for this problem. In this work, we formulate a novel view-specific person re-identification framework from the feature augmentation point of view, called Camera coRrelation Aware Feature augmenTation (CRAFT). Specifically, CRAFT performs cross-view adaptation by automatically measuring camera correlation from cross-view visual data distribution and adaptively conducting feature augmentation to transform the original features into a new adaptive space. Through our augmentation framework, view-generic learning algorithms can be readily generalized to learn and optimize view-specific sub-models whilst simultaneously modelling view-generic discrimination information. Therefore, our framework not only inherits the strength of view-generic model learning but also provides an effective way to take into account view specific characteristics. Our CRAFT framework can be extended to jointly learn view-specific feature transformations for person re-id across a large network with more than two cameras, a largely under-investigated but realistic re-id setting. Additionally, we present a domain-generic deep person appearance representation which is designed particularly to be towards view invariant for facilitating cross-view adaptation by CRAFT. We conducted extensively comparative experiments to validate the superiority and advantages of our proposed framework over state-of-the-art competitors on contemporary challenging person re-id datasets.
引用
收藏
页码:392 / 408
页数:17
相关论文
共 92 条
[81]   Visualizing and Understanding Convolutional Networks [J].
Zeiler, Matthew D. ;
Fergus, Rob .
COMPUTER VISION - ECCV 2014, PT I, 2014, 8689 :818-833
[82]   Learning a Discriminative Null Space for Person Re-identification [J].
Zhang, Li ;
Xiang, Tao ;
Gong, Shaogang .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1239-1248
[83]   Sample-Specific SVM Learning for Person Re-identification [J].
Zhang, Ying ;
Li, Baohua ;
Lu, Huchuan ;
Irie, Atshushi ;
Ruan, Xiang .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1278-1287
[84]   Learning Mid-level Filters for Person Re-identification [J].
Zhao, Rui ;
Ouyang, Wanli ;
Wang, Xiaogang .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :144-151
[85]   Person Re-identification by Salience Matching [J].
Zhao, Rui ;
Ouyang, Wanli ;
Wang, Xiaogang .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2528-2535
[86]   Unsupervised Salience Learning for Person Re-identification [J].
Zhao, Rui ;
Ouyang, Wanli ;
Wang, Xiaogang .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3586-3593
[87]   Scalable Person Re-identification: A Benchmark [J].
Zheng, Liang ;
Shen, Liyue ;
Tian, Lu ;
Wang, Shengjin ;
Wang, Jingdong ;
Tian, Qi .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1116-1124
[88]  
Zheng L, 2015, PROC CVPR IEEE, P1741, DOI 10.1109/CVPR.2015.7298783
[89]   Partial Person Re-identification [J].
Zheng, Wei-Shi ;
Li, Xiang ;
Xiang, Tao ;
Liao, Shengcai ;
Lai, Jianhuang ;
Gong, Shaogang .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4678-4686
[90]   Towards Open-World Person Re-Identification by One-Shot Group-Based Verification [J].
Zheng, Wei-Shi ;
Gong, Shaogang ;
Xiang, Tao .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (03) :591-606