Interactive Multi-level Stroke Control for Neural Style Transfer

被引:2
作者
Reimann, Max [1 ]
Buchheim, Benito [1 ]
Semmo, Amir [2 ]
Doellner, Jurgen [1 ]
Trapp, Matthias [1 ]
机构
[1] Univ Potsdam, Hasso Plattner Inst, Potsdam, Germany
[2] Digital Masterpieces GmbH, Potsdam, Germany
来源
2021 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2021) | 2021年
关键词
neural style transfer; local adjustments; mobile devices; artistic rendering; interaction;
D O I
10.1109/CW52790.2021.00009
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present StyleTune, a mobile app for interactive multi-level control of neural style transfers that facilitates creative adjustments of style elements and enables high output fidelity. In contrast to current mobile neural style transfer apps, StyleTune supports users to adjust both the size and orientation of style elements, such as brushstrokes and texture patches, on a global as well as local level. To this end, we propose a novel stroke-adaptive feed-forward style transfer network, that enables control over stroke size and intensity and allows a larger range of edits than current approaches. For additional level-of-control, we propose a network-agnostic method for stroke-orientation adjustment by utilizing the rotation-variance of Convolutional Neural Networks (CNNs). To achieve high output fidelity, we further add a patch-based style transfer method that enables users to obtain output resolutions of more than 20 Megapixel (Mpix). Our approach empowers users to create many novel results that are not possible with current mobile neural style transfer apps.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [41] Direction-aware neural style transfer with texture enhancement
    Wu, Hao
    Sun, Zhengxing
    Zhang, Yan
    Li, Qian
    NEUROCOMPUTING, 2019, 370 : 39 - 55
  • [42] Multi-granularity Brushstrokes Network for Universal Style Transfer
    Wang, Quan
    Li, Sheng
    Zhang, Xinpeng
    Feng, Guorui
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (04)
  • [43] Integrating Geometric Data into Topology Optimization via Neural Style Transfer
    Vulimiri, Praveen S.
    Deng, Hao
    Dugast, Florian
    Zhang, Xiaoli
    To, Albert C.
    MATERIALS, 2021, 14 (16)
  • [44] An Edge Filter Based Approach of Neural Style Transfer to the Image Stylization
    Bagwari, Shubham
    Choudhary, Kanika
    Raikwar, Suresh
    Nijhawan, Rahul
    Kumar, Sunil
    Shah, Mohd Asif
    IEEE ACCESS, 2022, 10 : 104612 - 104621
  • [45] Neural style transfer in tiny sets of ultrasound images for data augmentation
    Camargo, A. M.
    Olveres, J.
    Escalante-Ramirez, B.
    OPTICS, PHOTONICS, AND DIGITAL TECHNOLOGIES FOR IMAGING APPLICATIONS VIII, 2024, 12998
  • [46] Voxel-Based Three-Dimensional Neural Style Transfer
    Friedrich, Timo
    Hammer, Barbara
    Menzel, Stefan
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, IWANN 2021, PT I, 2021, 12861 : 334 - 346
  • [47] Neural Style Transfer With Adaptive Auto-Correlation Alignment Loss
    Zhou, Zheng
    Wu, Yue
    Yang, Xiaofei
    Zhou, Yicong
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 1027 - 1031
  • [48] Rethinking Neural Style Transfer: Generating Personalized and Watermarked Stylized Images
    Wang, Quan
    Li, Sheng
    Zhang, Xinpeng
    Feng, Guorui
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6928 - 6937
  • [49] Robust Information Hiding Based on Neural Style Transfer with Artificial Intelligence
    Zhang, Xiong
    Zhang, Minqing
    Wang, Xu An
    Jiang, Wen
    Jiang, Chao
    Yang, Pan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 79 (02): : 1925 - 1938
  • [50] Ribbon Font Neural Style Transfer for OpenType-SVG Font
    Huang, Shih-Ting
    Hsieh, Tung-Ju
    SIGGRAPH ASIA 2022 POSTERS, SA 2022, 2022,