Interactive Multi-level Stroke Control for Neural Style Transfer

被引:2
|
作者
Reimann, Max [1 ]
Buchheim, Benito [1 ]
Semmo, Amir [2 ]
Doellner, Jurgen [1 ]
Trapp, Matthias [1 ]
机构
[1] Univ Potsdam, Hasso Plattner Inst, Potsdam, Germany
[2] Digital Masterpieces GmbH, Potsdam, Germany
来源
2021 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW 2021) | 2021年
关键词
neural style transfer; local adjustments; mobile devices; artistic rendering; interaction;
D O I
10.1109/CW52790.2021.00009
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present StyleTune, a mobile app for interactive multi-level control of neural style transfers that facilitates creative adjustments of style elements and enables high output fidelity. In contrast to current mobile neural style transfer apps, StyleTune supports users to adjust both the size and orientation of style elements, such as brushstrokes and texture patches, on a global as well as local level. To this end, we propose a novel stroke-adaptive feed-forward style transfer network, that enables control over stroke size and intensity and allows a larger range of edits than current approaches. For additional level-of-control, we propose a network-agnostic method for stroke-orientation adjustment by utilizing the rotation-variance of Convolutional Neural Networks (CNNs). To achieve high output fidelity, we further add a patch-based style transfer method that enables users to obtain output resolutions of more than 20 Megapixel (Mpix). Our approach empowers users to create many novel results that are not possible with current mobile neural style transfer apps.
引用
收藏
页码:1 / 8
页数:8
相关论文
共 50 条
  • [1] Application of multi-level adaptive neural network based on optimization algorithm in image style transfer
    Li, Hong-an
    Wang, Lanye
    Liu, Jun
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (29) : 73127 - 73149
  • [2] INTERACTIVE MULTI-LEVEL PROSODY CONTROL FOR EXPRESSIVE SPEECH SYNTHESIS
    Cornille, Tobias
    Wang, Fengna
    Bekker, Jessa
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 8312 - 8316
  • [3] ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation
    Chen, Dar-Yen
    Tennent, Hamish
    Hsu, Ching-Wen
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2024, 2024, : 8619 - 8628
  • [4] Interactive Artistic Multi-style Transfer
    Wang, Xiaohui
    Lyu, Yiran
    Huang, Junfeng
    Wang, Ziying
    Qin, Jingyan
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2021, 14 (01)
  • [5] Interactive Artistic Multi-style Transfer
    Xiaohui Wang
    Yiran Lyu
    Junfeng Huang
    Ziying Wang
    Jingyan Qin
    International Journal of Computational Intelligence Systems, 14
  • [6] Multi-level Interactive Medical Process Mining
    Canensi, Luca
    Leonardi, Giorgio
    Montani, Stefania
    Terenziani, Paolo
    ARTIFICIAL INTELLIGENCE IN MEDICINE, AIME 2017, 2017, 10259 : 256 - 260
  • [7] Thangka mural style transfer based on progressive style-attentional network and multi-level loss function
    Fang, Jie
    Li, Hang
    Jia, Ying
    Ji, Liqi
    Chen, Xin
    Wang, Nianyi
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (04)
  • [8] A multi-level probabilistic neural network
    Zong, Ning
    Hong, Xia
    ADVANCES IN NEURAL NETWORKS - ISNN 2007, PT 2, PROCEEDINGS, 2007, 4492 : 516 - +
  • [9] Neural Style Palette: A Multimodal and Interactive Style Transfer From a Single Style Image
    Virtusio, John Jethro
    Ople, Jose Jaena Mari
    Tan, Daniel Stanley
    Tanveer, M.
    Kumar, Neeraj
    Hua, Kai-Lung
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2245 - 2258
  • [10] Workspaces: A multi-level architectural style for synchronous groupware
    Phillips, WG
    Graham, TCN
    INTERACTIVE SYSTEMS: DESIGN, SPECIFICATION, AND VERIFICATION, 2003, 2844 : 92 - 106