Learning Disentangled Representations for Identity Preserving Surveillance Face Camouflage

被引:11
|
作者
Li, Jingzhi [1 ,2 ]
Han, Lutong [1 ,2 ]
Zhang, Hua [1 ,2 ]
Han, Xiaoguang [3 ]
Ge, Jingguo [1 ]
Cao, Xiaochun [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Inst Informat Engn, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Cyber Secur, Beijing, Peoples R China
[3] Shenzhen Res Inst Big Data, Shenzhen 518000, Peoples R China
[4] Peng Cheng Lab, Cyberspace Secur Res Ctr, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金; 国家重点研发计划;
关键词
PRIVACY; GAN;
D O I
10.1109/ICPR48806.2021.9412636
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we focus on protecting the facial privacy for people under the surveillance scenarios, by changing some visual appearances of the faces while keeping them recognizable by the current face recognition systems. This is a challenging problem because we need to retain the most important structures of the captured facial images, while modify the salient facial regions to protect personal privacy.To address this problem, we introduce a novel individual face protection model, which can camouflage the face appearance from the perspective of human visual perception and preserve the identity features of faces used for face authentication. To that end, we develop an encoder-decoder network architecture which can separately disentangle the facial feature representation into an appearance code and an identification code. Specifically, we first randomly divide the input face image into two groups, the source and target sets, where the identity and appearance codes can be correspondingly extracted.Then, we recombine the identity and appearance codes to synthesize a new face, which has the same identity as the source subject. Finally, the synthesized faces are employed to replace the original face to protect the individual privacy.Note that our model is end-to-end with a multi-task loss function, which can better preserve the identity and stabilize the training process.Experiments conducted on Cross-Age Celebrity dataset demonstrate the effectiveness of our model and validate our superiority in terms of visual quality and scalability.
引用
收藏
页码:9748 / 9755
页数:8
相关论文
共 50 条
  • [41] Disentangled Relational Representations for Explaining and Learning from Demonstration
    Hristov, Yordan
    Angelov, Daniel
    Burke, Michael
    Lascarides, Alex
    Ramamoorthy, Subramanian
    CONFERENCE ON ROBOT LEARNING, VOL 100, 2019, 100
  • [42] Adversarial Learning of Disentangled and Generalizable Representations of Visual Attributes
    Oldfield, James
    Panagakis, Yannis
    Nicolaou, Mihalis A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (08) : 3498 - 3509
  • [43] Learning Interpretable Disentangled Representations Using Adversarial VAEs
    Sarhan, Mhd Hasan
    Eslami, Abouzar
    Navab, Nassir
    Albarqouni, Shadi
    DOMAIN ADAPTATION AND REPRESENTATION TRANSFER AND MEDICAL IMAGE LEARNING WITH LESS LABELS AND IMPERFECT DATA, DART 2019, MIL3ID 2019, 2019, 11795 : 37 - 44
  • [44] Learning Disentangled Representations of Texts with Application to Biomedical Abstracts
    Jain, Sarthak
    Banner, Edward
    van de Meent, Jan-Willem
    Marshall, Iain J.
    Wallace, Byron C.
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 4683 - 4693
  • [45] Learning Disentangled Representations of Satellite Image Time Series
    Sanchez, Eduardo H.
    Serrurier, Mathieu
    Ortner, Mathias
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2019, PT III, 2020, 11908 : 306 - 321
  • [46] On learning disentangled representations for individual treatment effect estimation
    Chu, Jiebin
    Sun, Zhoujian
    Dong, Wei
    Shi, Jinlong
    Huang, Zhengxing
    JOURNAL OF BIOMEDICAL INFORMATICS, 2021, 124
  • [47] Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing
    Tu, Xiaoguang
    Ma, Zheng
    Zhao, Jian
    Du, Guodong
    Xie, Mei
    Feng, Jiashi
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2020, 11 (05)
  • [48] Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing
    Tu, Xiaoguang
    Ma, Zheng
    Zhao, Jian
    Du, Guodong
    Xie, Mei
    Feng, Jiashi
    ACM Transactions on Intelligent Systems and Technology, 2020, 11 (05):
  • [49] ChildPredictor: A Child Face Prediction Framework With Disentangled Learning
    Zhao, Yuzhi
    Po, Lai-Man
    Wang, Xuehui
    Yan, Qiong
    Shen, Wei
    Zhang, Yujia
    Liu, Wei
    Wong, Chun-Kit
    Pang, Chiu-Sing
    Ou, Weifeng
    Yu, Wing-Yin
    Liu, Buhua
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 3737 - 3752
  • [50] Learning a Facial Expression Embedding Disentangled from Identity
    Zhang, Wei
    Ji, Xianpeng
    Chen, Keyu
    Ding, Yu
    Fan, Changjie
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6755 - 6764