TC-GAN: Triangle Cycle-Consistent GANs for Face Frontalization with Facial Features Preserved

被引:4
作者
Cheng, Juntong [1 ,3 ,4 ]
Chen, Yi-Ping Phoebe [2 ]
Li, Minjun [1 ,3 ,4 ]
Jiang, Yu-Gang [1 ,3 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[2] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
[3] Fudan Univ, Joint Res Ctr Intelligent Video Technol, Shanghai, Peoples R China
[4] Jilian Technol Grp Video, Changchun, Jilin, Peoples R China
来源
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19) | 2019年
基金
中国国家自然科学基金;
关键词
GANs; face frontalization; image synthesis;
D O I
10.1145/3343031.3351031
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Face frontalization has always been an important field. Recently, with the introduction of generative adversarial networks (GANs), face frontalization has achieved remarkable success. A critical challenge during face frontalization is to ensure the features of the original profile image are retained. Even though some state-of-the-art methods can preserve identity features while rotating the face to the frontal view, they still have difficulty preserving facial expression features. Therefore, we propose the novel triangle cycle-consistent generative adversarial networks for the face frontalization task, termed TC-GAN. Our networks contain two generators and one discriminator. One of the generators generates the frontal contour, and the other generates the facial features. They work together to generate a photo-realistic frontal view of the face. We also introduce cycle-consistent loss to retain feature information effectively. To validate the advantages of TC-GAN, we apply it to the face frontalization task on two datasets. The experimental results demonstrate that our method can perform large-pose face frontalization while preserving the facial features (both identity and expression). To the best of our knowledge, TC-GAN outperforms the state-of-theart methods in the preservation of facial identity and expression features during face frontalization.
引用
收藏
页码:220 / 228
页数:9
相关论文
共 35 条
  • [1] [Anonymous], 2018, STYLE BASED GENERATO
  • [2] [Anonymous], 2017, P IEEE C COMP VIS PA
  • [3] [Anonymous], 2017, ARXIV170107875
  • [4] [Anonymous], 2017, ICCV
  • [5] [Anonymous], PROC CVPR IEEE
  • [6] A morphable model for the synthesis of 3D faces
    Blanz, V
    Vetter, T
    [J]. SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, : 187 - 194
  • [7] Blessing of Dimensionality: High-dimensional Feature and Its Efficient Compression for Face Verification
    Chen, Dong
    Cao, Xudong
    Wen, Fang
    Sun, Jian
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 3025 - 3032
  • [8] StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation
    Choi, Yunjey
    Choi, Minje
    Kim, Munyoung
    Ha, Jung-Woo
    Kim, Sunghun
    Choo, Jaegul
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8789 - 8797
  • [9] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622
  • [10] Gulrajani F., 2017, Improved training of wasserstein gans, P5767