Multi-style cartoonization: Leveraging multiple datasets with generative adversarial networks

被引:1
|
作者
Cai, Jianlu [1 ]
Li, Frederick W. B. [2 ]
Nan, Fangzhe [1 ]
Yang, Bailin [1 ,3 ]
机构
[1] Zhejiang Gongshang Univ, Dept Comp Sci & Technol, Hangzhou, Peoples R China
[2] Univ Durham, Dept Comp Sci, Durham, England
[3] Zhejiang Gongshang Univ, Dept Comp Sci, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
generative adversarial network; multi-style transfer; photo cartoonization;
D O I
10.1002/cav.2269
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Scene cartoonization aims to convert photos into stylized cartoons. While generative adversarial networks (GANs) can generate high-quality images, previous methods focus on individual images or single styles, ignoring relationships between datasets. We propose a novel multi-style scene cartoonization GAN that leverages multiple cartoon datasets jointly. Our main technical contribution is a multi-branch style encoder that disentangles representations to model styles as distributions over entire datasets rather than images. Combined with a multi-task discriminator and perceptual losses optimizing across collections, our model achieves state-of-the-art diverse stylization while preserving semantics. Experiments demonstrate that by learning from inter-dataset relationships, our method translates photos into cartoon images with improved realism and abstraction fidelity compared to prior arts, without iterative re-training for new styles. We introduce a multi-style scene cartoonization GAN aiming to enhance the technique of photo-to-cartoon conversion. By amalgamating multiple cartoon datasets and employing innovative encoding methods, our model achieves more realistic and abstract cartoon effects, surpassing previous approaches. By capturing relationships between datasets, we can provide high-quality cartoon images without the need for tedious iterative retraining, marking a subtle but significant advancement in the field. image
引用
收藏
页数:15
相关论文
共 50 条
  • [1] GAN-Based Multi-Style Photo Cartoonization
    Shu, Yezhi
    Yi, Ran
    Xia, Mengfei
    Ye, Zipeng
    Zhao, Wang
    Chen, Yang
    Lai, Yu-Kun
    Liu, Yong-Jin
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (10) : 3376 - 3390
  • [2] MCLGAN: a multi-style cartoonization method based on style condition information
    Li, Canlin
    Wang, Xinyue
    Yi, Ran
    Zhang, Wenjiao
    Bi, Lihua
    Ma, Lizhuang
    VISUAL COMPUTER, 2025, 41 (04) : 2529 - 2544
  • [3] Style Separation and Synthesis via Generative Adversarial Networks
    Zhang, Rui
    Tang, Sheng
    Li, Yu
    Guo, Junbo
    Zhang, Yongdong
    Li, Jintao
    Yan, Shuicheng
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 183 - 191
  • [4] Cartoon-Flow: A Flow-Based Generative Adversarial Network for Arbitrary-Style Photo Cartoonization
    Lee, Jieun
    Kim, Hyeonwoo
    Shim, Jonghwa
    Hwang, Eenjun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1241 - 1251
  • [5] SSSGAN: Satellite Style and Structure Generative Adversarial Networks
    Marin, Javier
    Escalera, Sergio
    REMOTE SENSING, 2021, 13 (19)
  • [6] Music style migration based on generative Adversarial Networks
    Ji, Zhen
    Shen, Dan
    ALEXANDRIA ENGINEERING JOURNAL, 2025, 118 : 292 - 305
  • [7] Leveraging generative adversarial networks for enhanced cryptographic key generation
    Singh, Purushottam
    Pranav, Prashant
    Anwar, Shamama
    Dutta, Sandip
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2024, 36 (22)
  • [8] NVCGAN: Leveraging Generative Adversarial Networks for Robust Voice Conversion
    Zhang, Guoyu
    Liu, Jingrui
    Bi, Wenhao
    Dongye, Guangcheng
    Zhang, Li
    Jing, Ming
    Yu, Jiguo
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 : 330 - 342
  • [9] Conditional Wasserstein Generative Adversarial Networks for Rebalancing Iris Image Datasets
    Li, Yung-Hui
    Aslam, Muhammad Saqlain
    Harfiya, Latifa Nabila
    Chang, Ching-Chun
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2021, E104D (09) : 1450 - 1458
  • [10] Tea Chrysanthemum Detection by Leveraging Generative Adversarial Networks and Edge Computing
    Qi, Chao
    Gao, Junfeng
    Chen, Kunjie
    Shu, Lei
    Pearson, Simon
    FRONTIERS IN PLANT SCIENCE, 2022, 13