Privacy-Protected Person Re-Identification via Virtual Samples

被引:7
作者
Lin, Yutian [1 ]
Guo, Xiaoyang [1 ]
Wang, Zheng [1 ]
Du, Bo [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Hubei Luojia Lab, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Pedestrians; Privacy; Training; Lighting; Image resolution; Data privacy; Data models; Person re-identification; virtual image; RANKING;
D O I
10.1109/TIFS.2023.3308299
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Most person re-identification (re-ID) approaches are based on representation learning of pedestrian images, which assume that the person's appearance captured by cameras in the target is fully available. However, the exposure of appearance could cause serious privacy leakages. To address this issue, we focus on a new privacy-protected person re-ID task where the person's appearance is unavailable for training. We first overcome the dilemma of lacking real person images by utilizing the virtual pedestrian samples (e.g., PersonX). Then, we introduce a composition of data augmentations to simulate real conditions, where the learned model is transferred to the real target in a black way. Specifically, the background behind, surrounding illumination, pose, scale, and attributes of pedestrians from the target scene, irrelevant to privacy, are utilized to generate virtual images. With above privacy-irrelevant information, we propose a Translation-Rendering-Sampling (TRS) framework to generate images toward the distribution of the real-world dataset (including background, pose, attribute, etc). Extensive experiments are conducted on several realistic re-ID datasets excluding the person's appearance. The experiments show that our method outperforms the baseline significantly as well as some transfer learning methods.
引用
收藏
页码:5495 / 5505
页数:11
相关论文
共 71 条
[41]   Cloning Outfits from Real-World Images to 3D Characters for Generalizable Person Re-Identification [J].
Wang, Yanan ;
Liang, Xuezhi ;
Liao, Shengcai .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :4890-4899
[42]   Surpassing Real-World Source Training Data: Random 3D Characters for Generalizable Person Re-Identification [J].
Wang, Yanan ;
Liao, Shengcai ;
Shao, Ling .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :3422-3430
[43]   Body Part-Level Domain Alignment for Domain-Adaptive Person Re-Identification With Transformer Framework [J].
Wang, Yiming ;
Qi, Guanqiu ;
Li, Shuang ;
Chai, Yi ;
Li, Huafeng .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 :3321-3334
[44]  
Wang Z, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4973
[45]   Person Transfer GAN to Bridge Domain Gap for Person Re-Identification [J].
Wei, Longhui ;
Zhang, Shiliang ;
Gao, Wen ;
Tian, Qi .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :79-88
[46]   Person Re-Identification by Context-Aware Part Attention and Multi-Head Collaborative Learning [J].
Wu, Dongming ;
Ye, Mang ;
Lin, Gaojie ;
Gao, Xin ;
Shen, Jianbing .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2022, 17 :115-126
[47]  
Wu GL, 2020, AAAI CONF ARTIF INTE, V34, P12362
[48]   Switchable Novel Object Captioner [J].
Wu, Yu ;
Jiang, Lu ;
Yang, Yi .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) :1162-1173
[49]   Learning to Anticipate Egocentric Actions by Imagination [J].
Wu, Yu ;
Zhu, Linchao ;
Wang, Xiaohan ;
Yang, Yi ;
Wu, Fei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :1143-1152
[50]   Less Is More: Learning from Synthetic Data with Fine-Grained Attributes for Person Re-Identification [J].
Xiang, Suncheng ;
Qian, Dahong ;
Guan, Mengyuan ;
Yan, Binjie ;
Liu, Ting ;
Fu, Yuzhuo ;
You, Guanjie .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (05)