Joint Visual and Temporal Consistency for Unsupervised Domain Adaptive Person Re-identification

被引:126
作者
Li, Jianing [1 ]
Zhang, Shiliang [1 ]
机构
[1] Peking Univ, Sch EE&CS, Dept Comp Sci, Beijing 100871, Peoples R China
来源
COMPUTER VISION - ECCV 2020, PT XXIV | 2020年 / 12369卷
基金
北京市自然科学基金;
关键词
Domain adaption; Person re-identification; Convolution neural networks;
D O I
10.1007/978-3-030-58586-0_29
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised domain adaptive person Re-IDentification (ReID) is challenging because of the large domain gap between source and target domains, as well as the lackage of labeled data on the target domain. This paper tackles this challenge through jointly enforcing visual and temporal consistency in the combination of a local one-hot classification and a global multi-class classification. The local one-hot classification assigns images in a training batch with different person IDs, then adopts a Self-Adaptive Classification (SAC) model to classify them. The global multi-class classification is achieved by predicting labels on the entire unlabeled training set with the Memory-based Temporal-guided Cluster (MTC). MTC predicts multi-class labels by considering both visual similarity and temporal consistency to ensure the quality of label prediction. The two classification models are combined in a unified framework, which effectively leverages the unlabeled data for discriminative feature learning. Experimental results on three large-scale ReID datasets demonstrate the superiority of proposed method in both unsupervised and unsupervised domain adaptive ReID tasks. For example, under unsupervised setting, our method outperforms recent unsupervised domain adaptive methods, which leverage more labels for training.
引用
收藏
页码:483 / 499
页数:17
相关论文
共 42 条
[21]  
Lin YT, 2019, AAAI CONF ARTIF INTE, P8738
[22]   Unsupervised Cross-dataset Person Re-identification by Transfer Learning of Spatial-Temporal Patterns [J].
Lv, Jianming ;
Chen, Weihang ;
Li, Qing ;
Yang, Can .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7948-7956
[23]  
Mao SN, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P883
[24]   Transferrable Prototypical Networks for Unsupervised Domain Adaptation [J].
Pan, Yingwei ;
Yao, Ting ;
Li, Yehao ;
Wang, Yu ;
Ngo, Chong-Wah ;
Mei, Tao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2234-2242
[25]  
Qi L, 2019, Arxiv, DOI arXiv:1904.03425
[26]   Performance Measures and a Data Set for Multi-target, Multi-camera Tracking [J].
Ristani, Ergys ;
Solera, Francesco ;
Zou, Roger ;
Cucchiara, Rita ;
Tomasi, Carlo .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :17-35
[27]   Pose-driven Deep Convolutional Model for Person Re-identification [J].
Su, Chi ;
Li, Jianing ;
Zhang, Shiliang ;
Xing, Junliang ;
Gao, Wen ;
Tian, Qi .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3980-3989
[28]  
Sun BC, 2016, AAAI CONF ARTIF INTE, P2058
[29]   FocalMix: Semi-Supervised Learning for 3D Medical Image Detection [J].
Wang, Dong ;
Zhang, Yuan ;
Zhang, Kexin ;
Wang, Liwei .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3950-3959
[30]  
Wang GC, 2019, AAAI CONF ARTIF INTE, P8933