ChildPredictor: A Child Face Prediction Framework With Disentangled Learning

被引:1
|
作者
Zhao, Yuzhi [1 ]
Po, Lai-Man [1 ]
Wang, Xuehui [2 ]
Yan, Qiong [3 ]
Shen, Wei [2 ]
Zhang, Yujia [1 ]
Liu, Wei [4 ]
Wong, Chun-Kit [1 ]
Pang, Chiu-Sing [1 ]
Ou, Weifeng [1 ]
Yu, Wing-Yin [1 ]
Liu, Buhua [5 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[2] Shanghai Jiao Tong Univ, Artificial Intelligence Inst, Shanghai 201100, Peoples R China
[3] SenseTime Res & Tetras AI, Hong Kong, Peoples R China
[4] ByteDance Ltd, Beijing 100080, Peoples R China
[5] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Face recognition; Faces; Genetics; Generative adversarial networks; Training; Glass; Skin; Child face prediction; disentangled learning; generative adversarial network; image-to-image translation; GENERATIVE ADVERSARIAL NETWORKS;
D O I
10.1109/TMM.2022.3164785
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The appearances of children are inherited from their parents, whichmakes it feasible to predict them. Predicting realistic children's faces may help settle many social problems, such as ageinvariant face recognition, kinship verification, and missing child identification. It can be regarded as an image-to-image translation task. Existing approaches usually assume domain information in the image-to-image translation can be interpreted by "style", i.e., the separation of image content and style. However, such separation is improper for the child face prediction, because the facial contours between children and parents are not the same. To address this issue, we propose a new disentangled learning strategy for children's face prediction. We assume that children's faces are determined by genetic factors (compact family features, e.g., face contour), external factors (facial attributes irrelevant to prediction, such as moustaches and glasses), and variety factors (individual properties for each child). On this basis, we formulate predictions as a mapping from parents' genetic factors to children's genetic factors, and disentangle them from external and variety factors. In order to obtain accurate genetic factors and perform the mapping, we propose a ChildPredictor framework. It transfers human faces to genetic factors by encoders and back by generators. Then, it learns the relationship between the genetic factors of parents and children through a mapping function. To ensure the generated faces are realistic, we collect a large Family Face Database to train ChildPredictor and evaluate it on the FF-Database validation set. Experimental results demonstrate that ChildPredictor is superior to other well-known image-to-image translation methods in predicting realistic and diverse child faces. Implementation codes can be found at https:// github.com/ zhaoyuzhi/ChildPredictor.
引用
收藏
页码:3737 / 3752
页数:16
相关论文
共 50 条
  • [1] Multimodal face aging framework via learning disentangled representation
    Liu, Lu
    Wang, Shenghui
    Wan, Lili
    Yu, Haibo
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 83
  • [2] Disentangled Link Prediction for Signed Social Networks via Disentangled Representation Learning
    Xu, Linchuan
    Wei, Xiaokai
    Cao, Jiannong
    Yu, Philip S.
    2017 IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2017, : 676 - 685
  • [3] An efficient deep learning framework for occlusion face prediction system
    Polisetty, S. Naveen Kumar
    Sivaprakasam, T.
    Sreeram, Indraneel
    KNOWLEDGE AND INFORMATION SYSTEMS, 2023, 65 (11) : 5043 - 5063
  • [4] An efficient deep learning framework for occlusion face prediction system
    S. Naveen Kumar Polisetty
    T. Sivaprakasam
    Indraneel Sreeram
    Knowledge and Information Systems, 2023, 65 : 5043 - 5063
  • [5] FACE RECOGNITION WITH DISENTANGLED FACIAL REPRESENTATION LEARNING AND DATA AUGMENTATION
    Tang, Chia-Hao
    Hsu, Gee-Sern Jison
    Yap, Moi Hoon
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1670 - 1674
  • [6] LEARNING DISENTANGLED FEATURES FOR NERF-BASED FACE RECONSTRUCTION
    Yan, Peizhi
    Ward, Rabab
    Wang, Dan
    Tang, Qiang
    Du, Shan
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1135 - 1139
  • [7] Learning Disentangled Representations for Identity Preserving Surveillance Face Camouflage
    Li, Jingzhi
    Han, Lutong
    Zhang, Hua
    Han, Xiaoguang
    Ge, Jingguo
    Cao, Xiaochun
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9748 - 9755
  • [8] Disentangled Representation Learning for 3D Face Shape
    Jiang, Zi-Hang
    Wu, Qianyi
    Chen, Keyu
    Zhang, Juyong
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11949 - 11958
  • [9] Unsupervised face image deblurring via disentangled representation learning
    Hu, Yufan
    Xia, Junyong
    Liu, Hongmin
    Wang, Xing
    PATTERN RECOGNITION LETTERS, 2024, 183 : 9 - 16
  • [10] Disentangled Representation Learning for Multiple Attributes Preserving Face Deidentification
    Gong, Maoguo
    Liu, Jialu
    Li, Hao
    Xie, Yu
    Tang, Zedong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (01) : 244 - 256