SEMANTIC UNFOLDING OF STYLEGAN LATENT SPACE

被引:2
作者
Shukor, Mustafa [1 ]
Yao, Xu [1 ]
Damodaran, Bharath Bushan [1 ]
Hellier, Pierre [1 ]
机构
[1] InterDigital Inc, Cesson Sevigne, France
来源
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2022年
关键词
Image editing; GAN; Normalizing flow; Disentanglement;
D O I
10.1109/ICIP46576.2022.9897791
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Generative adversarial networks (GANs) have proven to be surprisingly efficient for image editing by inverting and manipulating the latent code corresponding to an input real image. This editing property emerges from the disentangled nature of the latent space. In this paper, we identify that the facial attribute disentanglement is not optimal, thus facial editing relying on linear attribute separation is flawed. We thus propose to improve semantic disentanglement with supervision. Our method consists in learning a proxy latent representation using normalizing flows, and we show that this leads to a more efficient space for face image editing.
引用
收藏
页码:221 / 225
页数:5
相关论文
共 22 条
[1]   Image2StyleGAN++: How to Edit the Embedded Images? [J].
Abdal, Rameen ;
Qin, Yipeng ;
Wonka, Peter .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8293-8302
[2]   Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space? [J].
Abdal, Rameen ;
Qin, Yipeng ;
Wonka, Peter .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :4431-4440
[3]  
Arjovsky M, 2017, PR MACH LEARN RES, V70
[4]   Editing in Style: Uncovering the Local Semantics of GANs [J].
Collins, Edo ;
Bala, Raja ;
Price, Bob ;
Susstrunk, Sabine .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :5770-5779
[5]   Inverting the Generator of a Generative Adversarial Network [J].
Creswell, Antonia ;
Bharath, Anil Anthony .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (07) :1967-1974
[6]  
Dinh L, 2017, Arxiv, DOI [arXiv:1605.08803, 10.48550/arXiv.1605.08803, DOI 10.48550/ARXIV.1605.08803]
[7]  
Eastwood C., 2018, INT C LEARN REPR
[8]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[9]  
Guan SY, 2020, Arxiv, DOI arXiv:2007.01758
[10]  
Härkönen E, 2020, ADV NEUR IN, V33