Relation-Preserving Feature Embedding for Unsupervised Person Re-Identification

被引:15
作者
Wang, Xueping [1 ,2 ]
Liu, Min [3 ,4 ]
Wang, Fei [3 ,4 ]
Dai, Jianhua [1 ,2 ]
Liu, An-An [5 ]
Wang, Yaonan [3 ,4 ]
机构
[1] Hunan Normal Univ, Coll Informat Sci & Engn, Changsha 410081, Peoples R China
[2] Hunan Normal Univ, Prov Key Lab Intelligent Comp & Language Informat, Changsha 410081, Peoples R China
[3] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[4] Natl Engn Res Ctr RVC, Changsha 410082, Peoples R China
[5] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised learning; relation-preserving feature embedding; person re-identification;
D O I
10.1109/TMM.2023.3270636
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Some unsupervised approaches have been proposed recently for the person re-identification (ReID) problem since annotations of samples across cameras are time-consuming. However, most of these methods focus on the appearance content of the sample itself, and thus seldom take the structure relations among samples into account when learning the feature representation, which would provide a valuable guide for learning the representations of the samples. Thus hard samples may not be well solved due to the limited or even misleading information of the sample itself. To address this issue, in this article, we propose a Relation-Preserving Feature Embedding (RPE) model that leverages structure relations among samples to boost the performance of the unsupervised person ReID methods without requiring any sample annotations. RPE aims at integrating the sample content and the neighborhood structure relations among samples into the learning of feature embeddings by combining the advantages of the autoencoder and graph autoencoder. Specifically, a relation and content information fusion (RCIF) module is proposed to dynamically merge the information from both perspectives of content and relation levels for feature embedding learning. Also, due to the lack of the identity labels of samples, we adopt an adaptive optimization strategy to update the affinity relations among samples instead of the reconstruction of the whole affinity matrix for optimizing the RPE model, which is more suitable for the unsupervised ReID task. Rigorous experiments on three widely-used large-scale benchmarks for person ReID demonstrate the superiority of the proposed method over current state-of-the-art unsupervised methods.
引用
收藏
页码:714 / 723
页数:10
相关论文
共 54 条
[1]   Structural Deep Clustering Network [J].
Bo, Deyu ;
Wang, Xiao ;
Shi, Chuan ;
Zhu, Meiqi ;
Lu, Emiao ;
Cui, Peng .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :1400-1410
[2]   Multi-Level Factorisation Net for Person Re-Identification [J].
Chang, Xiaobin ;
Hospedales, Timothy M. ;
Xiang, Tao .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2109-2118
[3]   Improving Deep Visual Representation for Person Re-identification by Global and Local Image-language Association [J].
Chen, Dapeng ;
Li, Hongsheng ;
Liu, Xihui ;
Shen, Yantao ;
Shao, Jing ;
Yuan, Zejian ;
Wang, Xiaogang .
COMPUTER VISION - ECCV 2018, PT XVI, 2018, 11220 :56-73
[4]   Spatial-Temporal Attention-Aware Learning for Video-Based Person Re-Identification [J].
Chen, Guangyi ;
Lu, Jiwen ;
Yang, Ming ;
Zhou, Jie .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) :4192-4205
[5]  
Cheng JF, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P2973
[6]   Adaptive Graph Encoder for Attributed Graph Embedding [J].
Cui, Ganqu ;
Zhou, Jie ;
Yang, Cheng ;
Liu, Zhiyuan .
KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, :976-985
[7]  
Dai Z., 2021, Cluster contrast for unsupervised person re-identification
[8]   Feature Affinity-Based Pseudo Labeling for Semi-Supervised Person Re-Identification [J].
Ding, Guodong ;
Zhang, Shanshan ;
Khan, Salman ;
Tang, Zhenmin ;
Zhang, Jian ;
Porikli, Fatih .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (11) :2891-2902
[9]   Unsupervised Person Re-identification: Clustering and Fine-tuning [J].
Fan, Hehe ;
Zheng, Liang ;
Yan, Chenggang ;
Yang, Yi .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2018, 14 (04)
[10]  
Ge Y, 2020, INT C LEARN REPR ICL