Pseudo-Pair Based Self-Similarity Learning for Unsupervised Person Re-Identification

被引:47
作者
Wu, Lin [1 ]
Liu, Deyin [2 ]
Zhang, Wenying [3 ]
Chen, Dapeng [4 ]
Ge, Zongyuan [5 ]
Boussaid, Farid [1 ]
Bennamoun, Mohammed [1 ]
Shen, Jialie [6 ]
机构
[1] Univ Western Australia, Dept Comp Sci & Software Engn, Perth, WA 6009, Australia
[2] Anhui Univ, Anhui Prov Key Lab Multimodal Cognit Computat, Sch Artificial Intelligence, Hefei 230039, Peoples R China
[3] Zhengzhou Univ, Sch Informat Engn, Zhengzhou 450001, Peoples R China
[4] Huawei, Shenzhen 223632, Peoples R China
[5] Monash Univ, Monash Airdoc Res Ctr, Melbourne, Vic 3000, Australia
[6] City Univ London, Dept Comp Sci, London EC1V 0HB, England
基金
澳大利亚研究理事会; 安徽省自然科学基金;
关键词
Training; Electronic mail; Unsupervised learning; Australia; Annotations; Convolution; Cameras; Person re-identification; pseudo pair construction; unsupervised learning; self-similarity learning; ADAPTATION; NETWORKS;
D O I
10.1109/TIP.2022.3186746
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (re-ID) is of great importance to video surveillance systems by estimating the similarity between a pair of cross-camera person shorts. Current methods for estimating such similarity require a large number of labeled samples for supervised training. In this paper, we present a pseudo-pair based self-similarity learning approach for unsupervised person re-ID without human annotations. Unlike conventional unsupervised re-ID methods that use pseudo labels based on global clustering, we construct patch surrogate classes as initial supervision, and propose to assign pseudo labels to images through the pairwise gradient-guided similarity separation. This can cluster images in pseudo pairs, and the pseudos can be updated during training. Based on pseudo pairs, we propose to improve the generalization of similarity function via a novel self-similarity learning:it learns local discriminative features from individual images via intra-similarity, and discovers the patch correspondence across images via inter-similarity. The intra-similarity learning is based on channel attention to detect diverse local features from an image. The inter-similarity learning employs a deformable convolution with a non-local block to align patches for cross-image similarity. Experimental results on several re-ID benchmark datasets demonstrate the superiority of the proposed method over the state-of-the-arts.
引用
收藏
页码:4803 / 4816
页数:14
相关论文
共 74 条
[31]   Unsupervised Person Re-identification via Cross-Camera Similarity Exploration [J].
Lin, Yutian ;
Wu, Yu ;
Yan, Chenggang ;
Xu, Mingliang ;
Yang, Yi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :5481-5490
[32]  
Lin YT, 2019, AAAI CONF ARTIF INTE, P8738
[33]   View Confusion Feature Learning for Person Re-identification [J].
Liu, Fangyi ;
Zhang, Lei .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6638-6647
[34]   End-to-End Comparative Attention Networks for Person Re-Identification [J].
Liu, Hao ;
Feng, Jiashi ;
Qi, Meibin ;
Jiang, Jianguo ;
Yan, Shuicheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (07) :3492-3506
[35]   Hierarchical Gaussian Descriptor for Person Re-Identification [J].
Matsukawa, Tetsu ;
Okabe, Takahiro ;
Suzuki, Einoshin ;
Sato, Yoichi .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1363-1372
[36]  
Paszke A., 2017, AUTOMATIC DIFFERENTI
[37]   Unsupervised Cross-Dataset Transfer Learning for Person Re-identification [J].
Peng, Peixi ;
Xiang, Tao ;
Wang, Yaowei ;
Pontil, Massimiliano ;
Gong, Shaogang ;
Huang, Tiejun ;
Tian, Yonghong .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1306-1315
[38]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[39]   Person Re-Identification by Deep Learning Attribute-Complementary Information [J].
Schumann, Arne ;
Stiefelhagen, Rainer .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1435-1443
[40]  
Seth S., 2021, P BMVC, P1