Towards High-fidelity Artistic Image Vectorization via Texture-Encapsulated Shape Parameterization

被引:0
作者
Chen, Ye [1 ]
Ni, Bingbing [1 ,2 ]
Liu, Jinfan [1 ]
Huang, Xiaoyang [1 ]
Chen, Xuanhong [1 ,2 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai 200240, Peoples R China
[2] USC SJTU Inst Cultural & Creat Ind, Shanghai, Peoples R China
来源
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2024年
基金
美国国家科学基金会;
关键词
D O I
10.1109/CVPR52733.2024.01503
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a novel vectorized image representation scheme accommodating both shape/geometry and texture in a decoupled way, particularly tailored for reconstruction and editing tasks of artistic/design images such as Emojis and Cliparts. In the heart of this representation is a set of sparsely and unevenly located 2D control points. On one hand, these points constitute a collection of parametric/vectorized geometric primitives (e.g., curves and closed shapes) describing the shape characteristics of the target image. On the other hand, local texture codes, in terms of implicit neural network parameters, are spatially distributed into each control point, yielding local coordinate-to-RGB mappings within the anchored region of each control point. In the meantime, a zero-shot learning algorithm is developed to decompose an arbitrary raster image into the above representation, for the sake of high-fidelity image vectorization with convenient editing ability. Extensive experiments on a series of image vectorization and editing tasks well demonstrate the high accuracy offered by our proposed method, with a significantly higher image compression ratio over prior art.
引用
收藏
页码:15877 / 15886
页数:10
相关论文
共 33 条
[1]   SAL: Sign Agnostic Learning of Shapes from Raw Data [J].
Atzmon, Matan ;
Lipman, Yaron .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2562-2571
[2]   Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields [J].
Barron, Jonathan T. ;
Mildenhall, Ben ;
Tancik, Matthew ;
Hedman, Peter ;
Martin-Brualla, Ricardo ;
Srinivasan, Pratul P. .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :5835-5844
[3]   Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction [J].
Chabra, Rohan ;
Lenssen, Jan E. ;
Ilg, Eddy ;
Schmidt, Tanner ;
Straub, Julian ;
Lovegrove, Steven ;
Newcombe, Richard .
COMPUTER VISION - ECCV 2020, PT XXIX, 2020, 12374 :608-625
[4]   Learning Continuous Image Representation with Local Implicit Image Function [J].
Chen, Yinbo ;
Liu, Sifei ;
Wang, Xiaolong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8624-8634
[5]   Multi-scale Feature Fusion and Transformer Network for urban green space segmentation from high-resolution remote sensing images [J].
Cheng, Yong ;
Wang, Wei ;
Ren, Zhoupeng ;
Zhao, Yingfen ;
Liao, Yilan ;
Ge, Yong ;
Wang, Jun ;
He, Jiaxin ;
Gu, Yakang ;
Wang, Yixuan ;
Zhang, Wenjie ;
Zhang, Ce .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2023, 124
[6]  
Diebel James Richard, 2008, Bayesian Image Vectorization: the probabilistic inversion of vector image rasterization
[7]   Image vectorization and editing via linear gradient layer decomposition [J].
Du, Zheng-Jun ;
Kang, Liang-Fu ;
Tan, Jianchao ;
Gingold, Yotam ;
Xu, Kun .
ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (04)
[8]   Plenoxels: Radiance Fields without Neural Networks [J].
Fridovich-Keil, Sara ;
Yu, Alex ;
Tancik, Matthew ;
Chen, Qinhong ;
Recht, Benjamin ;
Kanazawa, Angjoo .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5491-5500
[9]  
github, 2005, US
[10]  
Gropp Amos, 2020, arXiv