Context-Aware Text-Based Binary mage Stylization and Synthesis

被引:18
作者
Yang, Shuai [1 ]
Liu, Jiaying [1 ]
Yang, Wenhan [1 ]
Guo, Zongming [1 ]
机构
[1] Peking Univ, Inst Comp Sci & Technol, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Texture synthesis; structure synthesis; context-aware; style transfer; image inpainting; COLOR TRANSFER; IMAGE; SEGMENTATION; ALGORITHMS;
D O I
10.1109/TIP.2018.2873064
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work, we present a new framework for the stylization of text-based binary images. First, our method stylizes the stroke-based geometric shape like text, symbols, and icons in the target binary image based on an input style image. Second, the composition of the stylized geometric shape and a background image is explored. To accomplish the task, we propose legibility-preserving structure and texture transfer algorithms, which progressively narrow the visual differences between the binary image and the style image. The stylization is then followed by a context-aware layout design algorithm, where the cues for both seamlessness and aesthetics are employed to determine the optimal layout of the shape in the background. Given the layout, the binary image is seamlessly embedded into the background by texture synthesis under a context-aware boundary constraint. According to the contents of binary images, our method can be applied to many fields. We show that the proposed method is capable of addressing the unsupervised text stylization problem and is superior to state-of-the-art style transfer methods in automatic artistic typography creation. Besides, extensive experiments on various tasks, such as visual-textual presentation synthesis, icon/symbol rendering, and structure-guided image inpainting demonstrate the effectiveness of the proposed method.
引用
收藏
页码:952 / 964
页数:13
相关论文
共 54 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], 2008, P NPAR 2008 ANN FRAN
[3]  
[Anonymous], 2017, PROC IEEE C COMPUT V
[4]  
[Anonymous], 2016, P IEEE C COMPUTER VI
[5]  
[Anonymous], ACM T GRAPH
[6]  
[Anonymous], 2016, ACM T GRAPH P SIGGRA
[7]  
[Anonymous], 2001, THESIS
[8]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[9]  
[Anonymous], 2016, ACM T GRAPH
[10]  
[Anonymous], P INT C COMP VIS