Unsupervised Generative Adversarial Network for Style Transfer using Multiple Discriminators

被引:0
作者
Akhtar, Mohd Rayyan [1 ]
Liu, Peng [1 ]
机构
[1] Dreampix AI Res Lab, Guangzhou, Peoples R China
来源
THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021) | 2022年 / 12083卷
关键词
Generative Adversarial Network; style transfer; Felzenszwalb segmentation; Gaussian kernel; trainable parameters;
D O I
10.1117/12.2623209
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Style transfer is the rendering of the content image into the style of another image, such that the content image achieves the stylization of the style image. In this paper, we propose the cartoonlization style transfer method by using multiple discriminators in the Generative Adversarial Network (GAN). Cartoon images have specific characteristics which include black outlines, smooth surfaces, blurred effects that separate them from real images. We preprocessed the input images by Felzenszwalb segmentation algorithm and Gaussian kernel to extract the individual features from the input cartoon image dataset. In this work, we have introduced the usage of three discriminators for each such feature to help the generator in learning and generalizing the input data distribution. The generator network used in this work contains only 0.8M trainable parameters, which leads to less inference time. This approach shows that our method with the small size generator network can learn to generate superior results as compared to other methods. Qualitative and quantitative comparison with other methods demonstrated the superiority of our method.
引用
收藏
页数:9
相关论文
共 23 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Image up-sampling using total-variation regularization with a new observation model
    Aly, HA
    Dubois, E
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (10) : 1647 - 1659
  • [3] CartoonGAN: Generative Adversarial Networks for Photo Cartoonization
    Chen, Yang
    Lai, Yu-Kun
    Liu, Yong-Jin
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 9465 - 9474
  • [4] Efficient graph-based image segmentation
    Felzenszwalb, PF
    Huttenlocher, DP
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 59 (02) : 167 - 181
  • [5] Gatys L. A., 2015, J Vision, DOI [DOI 10.1167/16.12.326, 10.1167/16.12.326]
  • [6] Goodfellow I., 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622
  • [7] Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
    Huang, Xun
    Belongie, Serge
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1510 - 1519
  • [8] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [9] Kingma D. P., 2015, P 3 INT C LEARN REPR, P1
  • [10] Asymmetric GAN for Unpaired Image-to-Image Translation
    Li, Yu
    Tang, Sheng
    Zhang, Rui
    Zhang, Yongdong
    Li, Jintao
    Yan, Shuicheng
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) : 5881 - 5896