GENERATING ARTISTIC IMAGES VIA FEW-SHOT STYLE TRANSFER

被引:0
作者
Buchnik, Itay [1 ]
Berebi, Or [1 ]
Raviv, Tammy Riklin [1 ]
Shlezinger, Nir [1 ]
机构
[1] Ben Gurion Univ Negev, Sch Elect & Comp Engn, IL-84105 Beer Sheva, Israel
来源
2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW | 2023年
关键词
Style transfer; few-shot learning;
D O I
10.1109/ICASSPW59220.2023.10193400
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Generating images from a predefined style with heterogeneous and limited data is a challenging task for generative models. This work focuses on the conditional generation of artistic images, aiming to learn from a small set of paintings with high variability how to convert real-world photos into impressionistic paintings with the same given style. We design a few-shot style transfer model using a mixture of diverse one-shot style transfer generative models based on the SinGAN model. The proposed few-shot model coined EnSinGAN utilizes an ensemble of different SinGAN realizations to style transfer realistic photos to their closest painting style, by incorporating a novel aggregation mechanism based on the minimum cosine distance in the latent space of the feature vectors. EnSinGAN generates convincing impressionistic landscape images, and was awarded the first place in the Kaggle competition "I'm something of a painter myself" by being the closest in distribution to the test images.
引用
收藏
页数:5
相关论文
共 24 条
  • [1] DualAST: Dual Style-Learning Networks for Artistic Style Transfer
    Chen, Haibo
    Zhao, Lei
    Wang, Zhizhong
    Zhang, Huiming
    Zuo, Zhiwen
    Li, Ailin
    Xing, Wei
    Lu, Dongming
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 872 - 881
  • [2] SketchyGAN: Towards Diverse and Realistic Sketch to Image Synthesis
    Chen, Wengling
    Hays, James
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 9416 - 9425
  • [3] Image Style Transfer Using Convolutional Neural Networks
    Gatys, Leon A.
    Ecker, Alexander S.
    Bethge, Matthias
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2414 - 2423
  • [4] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [5] A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications
    Gui, Jie
    Sun, Zhenan
    Wen, Yonggang
    Tao, Dacheng
    Ye, Jieping
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 3313 - 3332
  • [6] Hensel M, 2017, ADV NEUR IN, V30
  • [7] PARAMETER-FREE STYLE PROJECTION FOR ARBITRARY IMAGE STYLE TRANSFER
    Huang, Siyu
    Xiong, Haoyi
    Wang, Tianyang
    Wen, Bihan
    Wang, Qingzhong
    Chen, Zeyu
    Huan, Jun
    Dou, Dejing
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2070 - 2074
  • [8] Content and Style Disentanglement for Artistic Style Transfer
    Kotovenko, Dmytro
    Sanakoyeu, Artsiom
    Lang, Sabine
    Ommer, Bjorn
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4421 - 4430
  • [9] The Contextual Loss for Image Transformation with Non-aligned Data
    Mechrez, Roey
    Talmi, Itamar
    Zelnik-Manor, Lihi
    [J]. COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 800 - 815
  • [10] A Style-Aware Content Loss for Real-Time HD Style Transfer
    Sanakoyeu, Artsiom
    Kotovenko, Dmytro
    Lang, Sabine
    Ommer, Bjoern
    [J]. COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 : 715 - 731