A Style-aware Discriminator for Controllable Image Translation

被引:17
作者
Kim, Kunhee [1 ]
Park, Sanghun [1 ]
Jeon, Eunyeong [1 ]
Kim, Taehun [1 ]
Kim, Daijin [1 ]
机构
[1] Pohang Univ Sci & Technol POSTECH, Pohang, South Korea
来源
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) | 2022年
关键词
D O I
10.1109/CVPR52688.2022.01770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current image-to-image translations do not control the output domain beyond the classes used during training, nor do they interpolate between different domains well, leading to implausible results. This limitation largely arises because labels do not consider the semantic distance. To mitigate such problems, we propose a style-aware discriminator that acts as a critic as well as a style encoder to provide conditions. The style-aware discriminator learns a controllable style space using prototype-based self-supervised learning and simultaneously guides the generator. Experiments on multiple datasets verify that the proposed model outperforms current state-of-the-art image-to-image translation methods. In contrast with current methods, the proposed approach supports various applications, including style interpolation, content transplantation, and local image translation.
引用
收藏
页码:18218 / 18227
页数:10
相关论文
共 43 条
  • [21] Jeon Eunyeong, 2021, ICIP
  • [22] Jiapeng Zhu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12362), P592, DOI 10.1007/978-3-030-58520-4_35
  • [23] Performance Comparison of Machine Learning Algorithms for Imbalanced Class Classification in Hydraulic System
    Joo, Yohan
    Kim, Kyutae
    Jeong, Jongpil
    [J]. PROCEEDINGS OF THE 2020 14TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM), 2020,
  • [24] Karras T., 2018, ICLR
  • [25] Karras T, 2020, ADV NEUR IN, V33
  • [26] Karras T, 2020, PROC CVPR IEEE, P8107, DOI 10.1109/CVPR42600.2020.00813
  • [27] A Style-Based Generator Architecture for Generative Adversarial Networks
    Karras, Tero
    Laine, Samuli
    Aila, Timo
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4396 - 4405
  • [28] Kim Hakyeong, 2021, CVPR
  • [29] Lee Hanbit, 2021, ARXIV210503117
  • [30] Li Ru, 2021, ARXIV210107555