Unpaired font family synthesis using conditional generative adversarial networks

被引:15
作者
Ul Hassan, Ammar [1 ]
Ahmed, Hammad [1 ]
Choi, Jaeyoung [1 ]
机构
[1] Soongsil Univ, Dept Comp Sci & Engn, Seoul, South Korea
关键词
Font generation; Generative adversarial networks; Style transfer; Unsupervised image-to-image translation; IMAGE SYNTHESIS;
D O I
10.1016/j.knosys.2021.107304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic font image synthesis has been an extremely active topic in recent years. Various deep learning-based approaches have been proposed to tackle this font synthesis task by considering it as an image-to-image translation problem in a supervised setting. However, all such approaches mainly focus on one-to-one font mapping, i.e., synthesizing a single font style, making it difficult to handle more practical problems such as the font family synthesis, which is a one-to-many mapping problem. Moreover, this font family synthesis is more challenging because it is an unsupervised image-to-image translation problem, i.e., no paired dataset is available during training. To address this font family synthesis problem, we propose a method that utilizes a single generator to conditionally produce various font family styles to form a font family. To the best of our knowledge, our proposed method is the first to synthesize a font family (multiple font styles belonging to a font), instead of synthesizing a single font style. More specifically, our method is trained to learn a font family by conditioning on various styles, e.g., normal, bold, italic, bold-italic, etc. After training, given an unobserved single font style (normal style font as an input), our method can successfully synthesize the remaining styles (e.g., bold, italic, bold-italic, etc.) to complete the font family. Qualitative and quantitative experiments were conducted to demonstrate the effectiveness of our proposed method. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
[11]   An unsupervised font style transfer model based on generative adversarial networks [J].
Sihan Zeng ;
Zhongliang Pan .
Multimedia Tools and Applications, 2022, 81 :5305-5324
[12]   Word Level Font-to-Font Image Translation using Convolutional Recurrent Generative Adversarial Networks [J].
Bhunia, Ankan Kumar ;
Bhunia, Ayan Kumar ;
Banerjee, Prithaj ;
Konwer, Aishik ;
Bhowmick, Abir ;
Roy, Partha Pratim ;
Pal, Umapada .
2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, :3645-3650
[13]   Surgical Tool Segmentation Using Generative Adversarial Networks With Unpaired Training Data [J].
Zhang, Zhongkai ;
Rosa, Benoit ;
Nageotte, Florent .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :6266-6273
[14]   Spatial interpolation using conditional generative adversarial neural networks [J].
Zhu, Di ;
Cheng, Ximeng ;
Zhang, Fan ;
Yao, Xin ;
Gao, Yong ;
Liu, Yu .
INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2020, 34 (04) :735-758
[15]   GlyphGAN: Style-consistent font generation based on generative adversarial networks [J].
Hayashi, Hideaki ;
Abe, Kohtaro ;
Uchida, Seiichi .
KNOWLEDGE-BASED SYSTEMS, 2019, 186
[16]   Generative Adversarial Networks for Unpaired Voice Transformation on Impaired Speech [J].
Chen, Li-Wei ;
Lee, Hung-Yi ;
Tsao, Yu .
INTERSPEECH 2019, 2019, :719-723
[17]   Unpaired Stain Transfer Using Pathology-Consistent Constrained Generative Adversarial Networks [J].
Liu, Shuting ;
Zhang, Baochang ;
Liu, Yiqing ;
Han, Anjia ;
Shi, Huijuan ;
Guan, Tian ;
He, Yonghong .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (08) :1977-1989
[18]   Retinal Vessel Segmentation Using Blending-Based Conditional Generative Adversarial Networks [J].
Saxena, Suraj ;
Lal, Kanhaiya ;
Joshi, Sharad .
COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2021, PT 1, 2021, 13052 :135-144
[19]   Smart Meter Data Masking Using Conditional Generative Adversarial Networks [J].
Khwaja, A. S. ;
Anpalagan, A. ;
Venkatesh, B. .
ELECTRIC POWER SYSTEMS RESEARCH, 2022, 209
[20]   High-resolution dermoscopy image synthesis with conditional generative adversarial networks [J].
Ding, Saisai ;
Zheng, Jian ;
Liu, Zhaobang ;
Zheng, Yanyan ;
Chen, Yanmei ;
Xu, Xiaomin ;
Lu, Jia ;
Xie, Jing .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 64