Doodle Master: A Doodle Beautification System Based on Auto-encoding Generative Adversarial Networks

被引:10
作者
Chen, Chien-Wen [1 ,2 ]
Chen, Wen-Cheng [3 ]
Hu, Min-Chun [3 ]
机构
[1] Natl Cheng Kung Univ, Grad Program Multimedia Syst & Intelligent Comp, Tainan, Taiwan
[2] Acad Sinica, Tainan, Taiwan
[3] Natl Cheng Kung Univ, Tainan, Taiwan
来源
PROCEEDINGS OF THE 2018 INTERNATIONAL JOINT WORKSHOP ON MULTIMEDIA ARTWORKS ANALYSIS AND ATTRACTIVENESS COMPUTING IN MULTIMEDIA (MMART&ACM'18) | 2018年
关键词
Auto-encoding Generative Adversarial Networks; VAE/GAN; Image beautification; Doodle Master;
D O I
10.1145/3209693.3209695
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
For those people without artistic talent, they can only draw rough or even awful doodles to express their ideas. We propose a doodle beautification system named Doodle Master, which can transfer a rough doodle to a plausible image and also keep the semantic concepts of the drawings. The Doodle Master applies the VAE/GAN model to decode and generate the beautified result from a constrained latent space. To achieve better performance for sketch data which is more like discrete distribution, a shared-weight method is proposed to improve the learnt features of the discriminator with the aid of the encoder. Furthermore, we design an interface for the user to draw with basic drawing tools and adjust the number of reconstruction times. The experiments show that the proposed Doodle Master system can successfully beautify the rough doodle or sketch in real-time.
引用
收藏
页码:2 / 7
页数:6
相关论文
共 17 条
[1]  
[Anonymous], 2015, ARXIV PREPRINT ARXIV
[2]  
[Anonymous], 2016, Semantic style transfer and turning two-bit doodles into fine artworks
[3]  
[Anonymous], 2015, PROC CVPR IEEE
[4]  
[Anonymous], 2017, VARIATIONAL APPROACH
[5]  
[Anonymous], 2014, COMPUTER VISION PATT
[6]  
[Anonymous], 2017, INT C COMP VIS ICCV
[7]  
[Anonymous], 2014, STAT-US
[8]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[9]  
Goodfellow Ian, 2016, Generative Adversarial Networks for Text
[10]  
Isola Phillip, 2017, C COMPUTER VISION PA