TC-GAN: Triangle Cycle-Consistent GANs for Face Frontalization with Facial Features Preserved

被引:5
作者
Cheng, Juntong [1 ,3 ,4 ]
Chen, Yi-Ping Phoebe [2 ]
Li, Minjun [1 ,3 ,4 ]
Jiang, Yu-Gang [1 ,3 ,4 ]
机构
[1] Fudan Univ, Sch Comp Sci, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[2] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
[3] Fudan Univ, Joint Res Ctr Intelligent Video Technol, Shanghai, Peoples R China
[4] Jilian Technol Grp Video, Changchun, Jilin, Peoples R China
来源
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19) | 2019年
基金
中国国家自然科学基金;
关键词
GANs; face frontalization; image synthesis;
D O I
10.1145/3343031.3351031
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Face frontalization has always been an important field. Recently, with the introduction of generative adversarial networks (GANs), face frontalization has achieved remarkable success. A critical challenge during face frontalization is to ensure the features of the original profile image are retained. Even though some state-of-the-art methods can preserve identity features while rotating the face to the frontal view, they still have difficulty preserving facial expression features. Therefore, we propose the novel triangle cycle-consistent generative adversarial networks for the face frontalization task, termed TC-GAN. Our networks contain two generators and one discriminator. One of the generators generates the frontal contour, and the other generates the facial features. They work together to generate a photo-realistic frontal view of the face. We also introduce cycle-consistent loss to retain feature information effectively. To validate the advantages of TC-GAN, we apply it to the face frontalization task on two datasets. The experimental results demonstrate that our method can perform large-pose face frontalization while preserving the facial features (both identity and expression). To the best of our knowledge, TC-GAN outperforms the state-of-theart methods in the preservation of facial identity and expression features during face frontalization.
引用
收藏
页码:220 / 228
页数:9
相关论文
共 35 条
[1]  
[Anonymous], 2018, STYLE BASED GENERATO
[2]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[3]  
[Anonymous], 2017, ARXIV170107875
[4]  
[Anonymous], 2017, ICCV
[5]  
[Anonymous], PROC CVPR IEEE
[6]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[7]   Blessing of Dimensionality: High-dimensional Feature and Its Efficient Compression for Face Verification [J].
Chen, Dong ;
Cao, Xudong ;
Wen, Fang ;
Sun, Jian .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3025-3032
[8]   StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622
[10]  
Gulrajani F., 2017, Improved training of wasserstein gans, P5767