Learning to Adapt Invariance in Memory for Person Re-Identification

被引:145
作者
Zhong, Zhun [1 ,2 ]
Zheng, Liang [3 ]
Luo, Zhiming [4 ]
Li, Shaozi [1 ]
Yang, Yi [2 ]
机构
[1] Xiamen Univ, Dept Artificial Intelligence, Xiamen 361005, Fujian, Peoples R China
[2] Univ Technol Sydney, Ctr Artificial Intelligence, Ultimo, NSW 2007, Australia
[3] Australian Natl Univ, Res Sch Comp Sci, Canberra, ACT 0200, Australia
[4] Xiamen Univ, Postdoctoral Mobile Stn Informat & Commun Engn, Xiamen 361005, Fujian, Peoples R China
基金
澳大利亚研究理事会;
关键词
Training; Cameras; Adaptation models; Reliability; Australia; Memory modules; Task analysis; Person re-identification; domain adaptation; invariance learning; exemplar memory; graph-based positive prediction; NEURAL-NETWORKS;
D O I
10.1109/TPAMI.2020.2976933
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work considers the problem of unsupervised domain adaptation in person re-identification (re-ID), which aims to transfer knowledge from the source domain to the target domain. Existing methods are primary to reduce the inter-domain shift between the domains, which however usually overlook the relations among target samples. This paper investigates into the intra-domain variations of the target domain and proposes a novel adaptation framework w.r.t three types of underlying invariance, i.e., Exemplar-Invariance, Camera-Invariance, and Neighborhood-Invariance. Specifically, an exemplar memory is introduced to store features of samples, which can effectively and efficiently enforce the invariance constraints over the global dataset. We further present the Graph-based Positive Prediction (GPP) method to explore reliable neighbors for the target domain, which is built upon the memory and is trained on the source samples. Experiments demonstrate that 1) the three invariance properties are complementary and indispensable for effective domain adaptation, 2) the memory plays a key role in implementing invariance learning and improves the performance with limited extra computation cost, 3) GPP can facilitate the invariance learning and thus significantly improves the results, and 4) our approach produces new state-of-the-art adaptation accuracy on three re-ID large-scale benchmarks.
引用
收藏
页码:2723 / 2738
页数:16
相关论文
共 71 条
[41]   Person Re-identification with Deep Similarity-Guided Graph Neural Network [J].
Shen, Yantao ;
Li, Hongsheng ;
Yi, Shuai ;
Chen, Dapeng ;
Wang, Xiaogang .
COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 :508-526
[42]  
Sohn Kihyuk, 2019, P INT C LEARN REPR
[43]  
Srivastava N, 2014, J MACH LEARN RES, V15, P1929
[44]  
Sukhbaatar S., 2015, P ADV NEUR INF PROC, P2440
[45]   Dissecting Person Re-identification from the Viewpoint of Viewpoint [J].
Sun, Xiaoxiao ;
Zheng, Liang .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :608-617
[46]   Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline) [J].
Sun, Yifan ;
Zheng, Liang ;
Yang, Yi ;
Tian, Qi ;
Wang, Shengjin .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :501-518
[47]   Adversarial Discriminative Domain Adaptation [J].
Tzeng, Eric ;
Hoffman, Judy ;
Saenko, Kate ;
Darrell, Trevor .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2962-2971
[48]  
Vinyals Oriol, 2015, Matching Networks for One Shot Learning
[49]   Transferable Joint Attribute-Identity Deep Learning for Unsupervised Person Re-Identification [J].
Wang, Jingya ;
Zhu, Xiatian ;
Gong, Shaogang ;
Li, Wei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2275-2284
[50]   Linkage Based Face Clustering via Graph Convolution Network [J].
Wang, Zhongdao ;
Zheng, Liang ;
Li, Yali ;
Wang, Shengjin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1117-+