Person in Uniforms Re-Identification

被引:0
作者
Xiang, Chong-yang [1 ,2 ]
Wu, Xiao [1 ,2 ]
He, Jun-Yan [3 ]
Yuan, Zhaoquan [1 ,2 ]
He, Tingquan [1 ,4 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu, Peoples R China
[2] Minist Educ, Engn Res Ctr Sustainable Urban Intelligent Transpo, Chengdu, Peoples R China
[3] Alibaba Grp, DAMO Acad, Shenzhen, Peoples R China
[4] Guangxi XinFaZhan Commun Grp Co Ltd, Nanning, Peoples R China
基金
中国国家自然科学基金;
关键词
Person Re-identification; feature disentangling; person in Uniforms;
D O I
10.1145/3703839
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Person in Uniforms Re-identification (PU-ReID) is an emerging computer vision task for various intelligent video surveillance applications. PU-ReID is much understudied due to the absence of large-scale annotated datasets, also this task is extremely challenging because many individuals captured in surveillance videos wear same clothing, introducing significant interference for retrieval tasks owing to the high visual similarity of outfits and subtle differences among individuals. This research initiates the exploration of person in uniforms re-identification, a novel and challenging task tailored for real industrial scenarios. To address these issues, a novel framework is proposed for PU-ReID, which aims to reduce the visual impact of similar uniforms and learn the unique cues derived from human parts and detailed visual features. Specifically, several novel techniques are built in this study: first, a uniform feature separation method with orthogonal constraints is proposed to extract non-uniform features. Second, multi-view subspace feature alignment is introduced to integrate soft- biometrics including optics-related visual features, contextual information of human parts, and cloth-invariant biometric features. In addition, to close the gap between academic research and real-world settings, a new person in uniforms ReID dataset named PU-151 is constructed, which consists of 151 gas station employees in uniforms from 1,488 videos. At last, extensive experiments conducted on five datasets demonstrate that the proposed approach significantly outperforms the state-of-the-art methods. This advancement can drive further developments in re-identification and person search technologies.
引用
收藏
页数:23
相关论文
共 55 条
[1]  
An Q., Cui K., Liu R., Wang C., Qi M., Ma H., Attention-Aware Multiple Granularities Network for Player Re-Identification, Proceedings of the ACM International Conference on Multimedia Workshop, pp. 137-144, (2022)
[2]  
Chan K.P.P., Hu X., Song H., Peng P., Chen K., Learning Disentangled Features for Person Re-Identification under Clothes Changing, ACM Trans. Multimedia Comput. Commun. Appl., 19, 6, (2023)
[3]  
Chen W., Xu X., Jia J., Luo H., Wang Y., Wang F., Jin R., Sun X., Beyond Appearance: A Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Tasks, Proceedings of the Conference on Computer Vision and Pattern Recognition, pp. 15050-15061, (2023)
[4]  
Chen X., Liu X., Liu W., Zhang X., Zhang Y., Mei T., Explainable Person Re-Identification with Attribute-Guided Metric Distillation, Proceedings of the International Conference on Computer Vision, pp. 11793-11802, (2021)
[5]  
Deng J., Dong W., Socher R., Li L.-J., Li K., Fei-Fei L., ImageNet: A Large-Scale Hierarchical Image Database, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 248-255, (2009)
[6]  
Eom C., Ham B., Learning Disentangled Representation for Robust Person Re-Identification, Proceedings of Advances in Neural Information Processing Systems, pp. 5298-5309, (2019)
[7]  
Gray D., Tao H., Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features, Proceedings of the European Conference on Computer Vision, pp. 262-275, (2008)
[8]  
Han Q., Liu H., Min W., Huang T., Lin D., Wang Q., 3D Skeleton and Two Streams Approach to Person Re-Identification Using Optimized Region Matching, ACM Trans. Multimedia Comput. Commun. Appl., 18, 2 S, pp. 1291-12917, (2022)
[9]  
Hao L., Wei J., Youzhi G., Fuxu L., Xingyu L., Shenqi L., Jianyang G., A Strong Baseline and Batch Normalization Neck for Deep Person Re-Identification, IEEE Trans. Multimedia, 22, 10, pp. 2597-2609, (2020)
[10]  
He K., Zhang X., Ren S., Sun J., Deep Residual Learning for Image Recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770-778, (2016)