Privacy-Protected Person Re-Identification via Virtual Samples

被引:7
作者
Lin, Yutian [1 ]
Guo, Xiaoyang [1 ]
Wang, Zheng [1 ]
Du, Bo [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Hubei Luojia Lab, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Pedestrians; Privacy; Training; Lighting; Image resolution; Data privacy; Data models; Person re-identification; virtual image; RANKING;
D O I
10.1109/TIFS.2023.3308299
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Most person re-identification (re-ID) approaches are based on representation learning of pedestrian images, which assume that the person's appearance captured by cameras in the target is fully available. However, the exposure of appearance could cause serious privacy leakages. To address this issue, we focus on a new privacy-protected person re-ID task where the person's appearance is unavailable for training. We first overcome the dilemma of lacking real person images by utilizing the virtual pedestrian samples (e.g., PersonX). Then, we introduce a composition of data augmentations to simulate real conditions, where the learned model is transferred to the real target in a black way. Specifically, the background behind, surrounding illumination, pose, scale, and attributes of pedestrians from the target scene, irrelevant to privacy, are utilized to generate virtual images. With above privacy-irrelevant information, we propose a Translation-Rendering-Sampling (TRS) framework to generate images toward the distribution of the real-world dataset (including background, pose, attribute, etc). Extensive experiments are conducted on several realistic re-ID datasets excluding the person's appearance. The experiments show that our method outperforms the baseline significantly as well as some transfer learning methods.
引用
收藏
页码:5495 / 5505
页数:11
相关论文
共 71 条
[1]  
[Anonymous], Kate Saenko's Twitter
[2]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[3]   Photographic Image Synthesis with Cascaded Refinement Networks [J].
Chen, Qifeng ;
Koltun, Vladlen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1520-1529
[4]   Instance-Guided Context Rendering for Cross-Domain Person Re-Identification [J].
Chen, Yanbei ;
Zhu, Xiatian ;
Gong, Shaogang .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :232-242
[5]  
Chen YC, 2019, AAAI CONF ARTIF INTE, P8215
[6]   IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID [J].
Dai, Yongxing ;
Liu, Jun ;
Sun, Yifan ;
Tong, Zekun ;
Zhang, Chi ;
Duan, Ling-Yu .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :11844-11854
[7]   Dual-Refinement: Joint Label and Feature Refinement for Unsupervised Domain Adaptive Person Re-Identification [J].
Dai, Yongxing ;
Liu, Jun ;
Bai, Yan ;
Tong, Zekun ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :7815-7829
[8]   Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification [J].
Deng, Weijian ;
Zheng, Liang ;
Ye, Qixiang ;
Kang, Guoliang ;
Yang, Yi ;
Jiao, Jianbin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :994-1003
[9]   Adaptive Exploration for Unsupervised Person Re-identification [J].
Ding, Yuhang ;
Fan, Hehe ;
Xu, Mingliang ;
Yang, Yi .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (01)
[10]   Unsupervised Person Re-identification: Clustering and Fine-tuning [J].
Fan, Hehe ;
Zheng, Liang ;
Yan, Chenggang ;
Yang, Yi .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2018, 14 (04)