Large-pose facial makeup transfer based on generative adversarial network combined face alignment and face parsing

被引:2
作者
Li, Qiming [1 ]
Tu, Tongyue [1 ]
机构
[1] Shanghai Maritime Univ, Dept Comp Sci & Technol, Shanghai 201306, Peoples R China
基金
中国国家自然科学基金; 上海市自然科学基金;
关键词
makeup transfer; generative adversarial network; large-pose face; face parsing; face alignment;
D O I
10.3934/mbe.2023034
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Facial makeup transfer is a special form of image style transfer. For the reference makeup image with large-pose, improving the quality of the image generated after makeup transfer is still a challenging problem worthy of discussion. In this paper, a large-pose makeup transfer algorithm based on generative adversarial network (GAN) is proposed. First, a face alignment module (FAM) is introduced to locate the key points, such as the eyes, mouth and skin. Secondly, a face parsing module (FPM) and face parsing losses are designed to analyze the source image and extract the face features. Then, the makeup style code is extracted from the reference image and the makeup transfer is completed through integrating facial features and makeup style code. Finally, a large-pose makeup transfer (LPMT) dataset is collected and constructed. Experiments are carried out on the traditional makeup transfer (MT) dataset and the new LPMT dataset. The results show that the image quality generated by the proposed method is better than that of the latest method for large -pose makeup transfer.
引用
收藏
页码:737 / 757
页数:21
相关论文
共 37 条
  • [1] PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup
    Chang, Huiwen
    Lu, Jingwan
    Yu, Fisher
    Finkelstein, Adam
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 40 - 48
  • [2] Diverse Image Style Transfer via Invertible Cross-Space Mapping
    Chen, Haibo
    Zhao, Lei
    Zhang, Huiming
    Wang, Zhizhong
    Zuo, Zhiwen
    Li, Ailin
    Xing, Wei
    Lu, Dongming
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14860 - 14869
  • [3] BeautyGlow: On-Demand Makeup Transfer Framework with Reversible Generative Network
    Chen, Hung-Jen
    Hui, Ka-Ming
    Wang, Szu-Yu
    Tsao, Li-Wu
    Shuai, Hong-Han
    Cheng, Wen-Huang
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10034 - 10042
  • [4] Spatially-invariant Style-codes Controlled Makeup Transfer
    Deng, Han
    Han, Chu
    Cai, Hongmin
    Han, Guoqiang
    He, Shengfeng
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6545 - 6553
  • [5] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [6] LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeup
    Gu, Qiao
    Wang, Guanzhi
    Chiu, Mang Tik
    Tai, Yu-Wing
    Tang, Chi-Keung
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 10480 - 10489
  • [7] Guo D, 2009, PROC CVPR IEEE, P73, DOI 10.1109/CVPRW.2009.5206833
  • [8] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [9] Hou Y., 2021, 2021 IEEE CVF C COMP, P13824, DOI [10.1109/CVPR46437.2021.01361, DOI 10.1109/CVPR46437.2021.01361]
  • [10] Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
    Huang, Xun
    Belongie, Serge
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1510 - 1519