ChildPredictor: A Child Face Prediction Framework With Disentangled Learning

被引:1
作者
Zhao, Yuzhi [1 ]
Po, Lai-Man [1 ]
Wang, Xuehui [2 ]
Yan, Qiong [3 ]
Shen, Wei [2 ]
Zhang, Yujia [1 ]
Liu, Wei [4 ]
Wong, Chun-Kit [1 ]
Pang, Chiu-Sing [1 ]
Ou, Weifeng [1 ]
Yu, Wing-Yin [1 ]
Liu, Buhua [5 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[2] Shanghai Jiao Tong Univ, Artificial Intelligence Inst, Shanghai 201100, Peoples R China
[3] SenseTime Res & Tetras AI, Hong Kong, Peoples R China
[4] ByteDance Ltd, Beijing 100080, Peoples R China
[5] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Face recognition; Faces; Genetics; Generative adversarial networks; Training; Glass; Skin; Child face prediction; disentangled learning; generative adversarial network; image-to-image translation; GENERATIVE ADVERSARIAL NETWORKS;
D O I
10.1109/TMM.2022.3164785
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The appearances of children are inherited from their parents, whichmakes it feasible to predict them. Predicting realistic children's faces may help settle many social problems, such as ageinvariant face recognition, kinship verification, and missing child identification. It can be regarded as an image-to-image translation task. Existing approaches usually assume domain information in the image-to-image translation can be interpreted by "style", i.e., the separation of image content and style. However, such separation is improper for the child face prediction, because the facial contours between children and parents are not the same. To address this issue, we propose a new disentangled learning strategy for children's face prediction. We assume that children's faces are determined by genetic factors (compact family features, e.g., face contour), external factors (facial attributes irrelevant to prediction, such as moustaches and glasses), and variety factors (individual properties for each child). On this basis, we formulate predictions as a mapping from parents' genetic factors to children's genetic factors, and disentangle them from external and variety factors. In order to obtain accurate genetic factors and perform the mapping, we propose a ChildPredictor framework. It transfers human faces to genetic factors by encoders and back by generators. Then, it learns the relationship between the genetic factors of parents and children through a mapping function. To ensure the generated faces are realistic, we collect a large Family Face Database to train ChildPredictor and evaluate it on the FF-Database validation set. Experimental results demonstrate that ChildPredictor is superior to other well-known image-to-image translation methods in predicting realistic and diverse child faces. Implementation codes can be found at https:// github.com/ zhaoyuzhi/ChildPredictor.
引用
收藏
页码:3737 / 3752
页数:16
相关论文
共 50 条
[31]   Anonymization of face images with Contrastive Learning [J].
Xu, Xintong ;
Cui, Run ;
Huang, Chanying ;
Yan, Kedong .
COMPUTER JOURNAL, 2023, 67 (05) :1910-1919
[32]   Deep learning for face recognition at a distance [J].
Guei, Axel-Christian ;
Akhloufi, Moulay A. .
DISRUPTIVE TECHNOLOGIES IN INFORMATION SCIENCES, 2018, 10652
[33]   Towards High-Quality and Disentangled Face Editing in a 3D GAN [J].
Jiang, Kaiwen ;
Chen, Shu-Yu ;
Liu, Feng-Lin ;
Fu, Hongbo ;
Gao, Lin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2025, 47 (04) :2533-2544
[34]   Disentangled Contrastive Learning for Social Recommendation [J].
Wu, Jiahao ;
Fan, Wenqi ;
Chen, Jingfan ;
Liu, Shengcai ;
Li, Qing ;
Tang, Ke .
PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, :4570-4574
[35]   MOONEY FACE CLASSIFICATION AND PREDICTION BY LEARNING ACROSS TONE [J].
Ke, Tsung-Wei ;
Yu, Stella X. ;
Whitney, David .
2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, :2025-2029
[36]   On Learning Disentangled Representations for Gait Recognition [J].
Zhang, Ziyuan ;
Tran, Luan ;
Liu, Feng ;
Liu, Xiaoming .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) :345-360
[37]   Learning shape and texture progression for young child face aging [J].
Liu, Lu ;
Yu, Haibo ;
Wang, Shenghui ;
Wan, Lili ;
Han, Shanshan .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 93
[38]   FCD-Net: Learning to Detect Multiple Types of Homologous Deepfake Face Images [J].
Han, Ruidong ;
Wang, Xiaofeng ;
Bai, Ningning ;
Wang, Qin ;
Liu, Zinian ;
Xue, Jianru .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2023, 18 :2653-2666
[39]   A survey on deep learning based face recognition [J].
Guo, Guodong ;
Zhang, Na .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 189
[40]   Child face recognition at scale: synthetic data generation and performance benchmark [J].
Falkenberg, Magnus ;
Ottsen, Anders Bensen ;
Ibsen, Mathias ;
Rathgeb, Christian .
FRONTIERS IN SIGNAL PROCESSING, 2024, 4