FACE PHOTO SYNTHESIS VIA INTERMEDIATE SEMANTIC ENHANCEMENT GENERATIVE ADVERSARIAL NETWORK

被引:1
作者
Li, Haoxian [1 ]
Zheng, Jieying [1 ]
Liu, Feng [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Jiangsu Key Lab Image Proc & Image Commun, Nanjing, Peoples R China
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
基金
中国国家自然科学基金;
关键词
deep learning; face sketch-photo synthesis; generative adversarial network; face parsing;
D O I
10.1109/ICIP46576.2022.9897523
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face sketch-photo synthesis is an important task in computer vision now. Recently, researchers have introduced face parsing to further improve the quality of synthesized face images. However, the semantic difference between face sketch parsing and photo parsing is usually ignored, leading to deformations and aliasing on synthesized face images. To solve these problems, we propose an intermediate face parsing to enhance the semantic information of the input face parsing. According to this intermediate face parsing, we propose an Intermediate Semantic Enhancement Generative Adversarial Network (ISEGAN) to generate high-quality realistic face photos. Furthermore, a Parsing Matching Loss (PM Loss) is proposed to encourage the intermediate face parsing to be more semantically accurate. Extensive comparison experiments demonstrate that our ISEGAN significantly outperforms the state-of-the-art methods.
引用
收藏
页码:96 / 100
页数:5
相关论文
共 22 条
[1]   A new LDA-based face recognition system which can solve the small sample size problem [J].
Chen, LF ;
Liao, HYM ;
Ko, MT ;
Lin, JC ;
Yu, GJ .
PATTERN RECOGNITION, 2000, 33 (10) :1713-1726
[2]   Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation [J].
Gao, Fei ;
Xu, Xingxin ;
Yu, Jun ;
Shang, Meimei ;
Li, Xiang ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :3487-3498
[3]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[4]  
Heusel M, 2017, ADV NEUR IN, V30
[5]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[6]  
Li J., 2020, IEEE T NEUR NET LEAR, P1
[7]  
Li X., 2021, IEEE INT C MULTIMEDI, P1
[8]   DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion [J].
Ma, Jiayi ;
Xu, Han ;
Jiang, Junjun ;
Mei, Xiaoguang ;
Zhang, Xiao-Ping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :4980-4995
[9]   Semantic Image Synthesis with Spatially-Adaptive Normalization [J].
Park, Taesung ;
Liu, Ming-Yu ;
Wang, Ting-Chun ;
Zhu, Jun-Yan .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2332-2341
[10]  
Parkhi O.M., 2015, Deep face recognition