Multi-style cartoonization: Leveraging multiple datasets with generative adversarial networks

被引:1
|
作者
Cai, Jianlu [1 ]
Li, Frederick W. B. [2 ]
Nan, Fangzhe [1 ]
Yang, Bailin [1 ,3 ]
机构
[1] Zhejiang Gongshang Univ, Dept Comp Sci & Technol, Hangzhou, Peoples R China
[2] Univ Durham, Dept Comp Sci, Durham, England
[3] Zhejiang Gongshang Univ, Dept Comp Sci, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
generative adversarial network; multi-style transfer; photo cartoonization;
D O I
10.1002/cav.2269
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scene cartoonization aims to convert photos into stylized cartoons. While generative adversarial networks (GANs) can generate high-quality images, previous methods focus on individual images or single styles, ignoring relationships between datasets. We propose a novel multi-style scene cartoonization GAN that leverages multiple cartoon datasets jointly. Our main technical contribution is a multi-branch style encoder that disentangles representations to model styles as distributions over entire datasets rather than images. Combined with a multi-task discriminator and perceptual losses optimizing across collections, our model achieves state-of-the-art diverse stylization while preserving semantics. Experiments demonstrate that by learning from inter-dataset relationships, our method translates photos into cartoon images with improved realism and abstraction fidelity compared to prior arts, without iterative re-training for new styles. We introduce a multi-style scene cartoonization GAN aiming to enhance the technique of photo-to-cartoon conversion. By amalgamating multiple cartoon datasets and employing innovative encoding methods, our model achieves more realistic and abstract cartoon effects, surpassing previous approaches. By capturing relationships between datasets, we can provide high-quality cartoon images without the need for tedious iterative retraining, marking a subtle but significant advancement in the field. image
引用
收藏
页数:15
相关论文
共 50 条
  • [31] MULTI-RESOLUTION GENERATIVE ADVERSARIAL NETWORKS FOR TINY-SCALE PEDESTRIAN DETECTION
    RuihaoYin
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1665 - 1669
  • [32] Combining generative adversarial networks and multi-output CNN for motor imagery classification
    Xie, Jiaxin
    Chen, Siyu
    Zhang, Yongqing
    Gao, Dongrui
    Liu, Tiejun
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (04)
  • [33] Multi-modal generative adversarial networks for traffic event detection in smart cities
    Chen, Qi
    Wang, Wei
    Huang, Kaizhu
    De, Suparna
    Coenen, Frans
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 177
  • [34] SDP-GAN: Saliency Detail Preservation Generative Adversarial Networks for High Perceptual Quality Style Transfer
    Li, Ru
    Wu, Chi-Hao
    Liu, Shuaicheng
    Wang, Jue
    Wang, Guangfu
    Liu, Guanghui
    Zeng, Bing
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 374 - 385
  • [35] Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer
    Chen, Xinyuan
    Xu, Chang
    Yang, Xiaokang
    Song, Li
    Tao, Dacheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (02) : 546 - 560
  • [36] Textured Mesh Generation Using Multi-View and Multi-Source Supervision and Generative Adversarial Networks
    Wen, Mingyun
    Park, Jisun
    Cho, Kyungeun
    REMOTE SENSING, 2021, 13 (21)
  • [37] Multi-scale reconstruction of porous media based on progressively growing generative adversarial networks
    Xia, Pengfei
    Bai, Hualin
    Zhang, Ting
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2022, 36 (11) : 3685 - 3705
  • [38] MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks
    Xu, Han
    Ma, Jiayi
    Zhang, Xiao-Ping
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7203 - 7216
  • [39] GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks
    Yang, Zhiguang
    Chen, Youping
    Le, Zhuliang
    Ma, Yong
    NEURAL COMPUTING & APPLICATIONS, 2021, 33 (11) : 6133 - 6145
  • [40] Dual Generator Generative Adversarial Networks for Multi-domain Image-to-Image Translation
    Tang, Hao
    Xu, Dan
    Wang, Wei
    Yan, Yan
    Sebe, Nicu
    COMPUTER VISION - ACCV 2018, PT I, 2019, 11361 : 3 - 21